-- Logs begin at Thu 2022-05-19 13:32:35 UTC, end at Thu 2022-05-19 15:06:31 UTC. -- May 19 14:08:39.414257 dv-cinder-788367-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 14:08:39.424514 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 14:08:39 2022] *** May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: nodename: dv-cinder-788367-10-iscsi May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: machine: x86_64 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: clock source: unix May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: pcre jit disabled May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: detected number of CPU cores: 4 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: current working directory: / May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: detected binary path: /usr/bin/uwsgi-core May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: your processes number limit is 47680 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: your memory page size is 4096 bytes May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: detected max file descriptor number: 2048 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: lock engine: pthread robust mutexes May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: thunder lock: enabled May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 14:08:39.427051 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 14:08:39.470801 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: Python main interpreter initialized at 0x555bcb6999c0 May 19 14:08:39.470801 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: python threads support enabled May 19 14:08:39.470801 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: your server socket listen backlog is limited to 100 connections May 19 14:08:39.470801 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: your mercy for graceful operations on workers is 90 seconds May 19 14:08:39.471140 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: mapped 403077 bytes (393 KB) for 2 cores May 19 14:08:39.471214 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: *** Operational MODE: preforking *** May 19 14:08:39.471495 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: *** uWSGI is running in multiple interpreter mode *** May 19 14:08:39.471495 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: spawned uWSGI master process (pid: 80233) May 19 14:08:39.471690 dv-cinder-788367-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 14:08:39.472525 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: spawned uWSGI worker 1 (pid: 80246, cores: 1) May 19 14:08:39.472625 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: spawned uWSGI worker 2 (pid: 80247, cores: 1) May 19 14:08:39.473538 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 14:08:45.136501 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:08:45.136501 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: from cryptography.utils import int_from_bytes May 19 14:08:45.137317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:08:45.137317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: from cryptography.utils import int_from_bytes May 19 14:08:45.178043 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:08:45.178043 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: from cryptography.utils import int_from_bytes May 19 14:08:45.178536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:08:45.178536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: from cryptography.utils import int_from_bytes May 19 14:08:45.186680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:08:45.186894 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:08:45.187086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] command line args: [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:08:45.187352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:08:45.187532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ================================================================================ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:08:45.187783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] admin_token = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.188029 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] config_dir = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.188217 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.188398 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] config_source = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.188576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] debug = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.188773 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.189259 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.189357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.189552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.189798 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.190027 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.190206 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_config_append = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.190382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.190592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_dir = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.190730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.190989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.191236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.191482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.191729 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.191906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.192079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.192322 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.192567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.192800 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.193033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.193266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.193501 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.193747 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.193991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.194267 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.194753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.194966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] publish_errors = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.195199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.195430 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.195608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.195852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.196088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.196321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] standard_threads = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.196551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.196793 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.196968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.197142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] use_journal = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.197316 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] use_json = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.197489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] use_stderr = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.197667 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] use_syslog = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.198432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.198687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.198958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.199221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.199460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.199711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.199950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.200197 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.200432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.200681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.200928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.201230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.201413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.201663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.201899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.202146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.202393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.202632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.202912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.203171 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.203418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.203654 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.203907 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.204169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.204423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.204670 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.204902 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.205133 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.205365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.205600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.205848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.206095 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.206326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.206556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.206823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.207072 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.207311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.207563 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.207795 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.208030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.208263 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.208493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.208722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.208951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.209180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.209416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.209663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.209895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.210132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.210361 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.210595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.210856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.211106 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.211336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.211574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.211811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.212049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.212286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.212521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.212750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.212996 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.213230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.213515 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.214245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.214503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.214738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.214995 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.215235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.215471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.215738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.215974 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.216222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.216464 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.216703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.216962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.217170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.217417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.217659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.217895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.218134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.218373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.218611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.218868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.219108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.219344 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.219613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.219848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.220089 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.220329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.220570 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.220809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.221042 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.221281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.221514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.221745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.221977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.222212 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.222442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.222685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.222942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.223193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.223432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.223813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.224074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.224319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.224553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.external = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.224786 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.225081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.225313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.225546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.password = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.225779 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.token = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.225930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:08:45.226007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.226077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:08:45.226247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.226322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] command line args: [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:08:45.226495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.226585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:08:45.226657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ================================================================================ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:08:45.226724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.226946 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] admin_token = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.227023 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.227336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] config_dir = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.227423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.227485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.227542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.227599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] config_source = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.227682 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.227748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] debug = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.227893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.227984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.228127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.228193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.228303 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.228400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.228552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.228633 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.228795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.228871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.229042 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.229619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.229722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_config_append = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.229881 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.229988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.230083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_dir = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.230183 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.230278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.230573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.230668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.230768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.230901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.231010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.231112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.231206 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.231299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.231299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.231525 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.231632 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.231729 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.231829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.231932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.232026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.232104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.232185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.232318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.232437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.232551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.232708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.232795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.232919 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.233022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.233142 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.233435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.233542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.233542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.233739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.233848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.233953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.234048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.234174 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] publish_errors = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.234285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.234414 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.234525 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.234628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.234724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.234882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.234998 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.235096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.235549 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.235623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.235741 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] standard_threads = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.235824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.235896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.235956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.236019 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.236078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.236143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.236264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] use_journal = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.236330 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.236463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] use_json = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.236545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.236605 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] use_stderr = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.236738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.236807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] use_syslog = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.236976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:08:45.237041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.237990 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238422 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.238896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239052 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239297 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.239897 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240536 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.240852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241011 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241563 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.241969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242446 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.242761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243097 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.243960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.244108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.244193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.244348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.244417 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.244574 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.244648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.245390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.245517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.245639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.245707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.245868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.245935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246099 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246174 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246638 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.246901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247523 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247626 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.247971 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248045 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248676 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.248915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249002 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.249922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250527 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250610 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.250862 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251256 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251335 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.251949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252183 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252569 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252651 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.252948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253582 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253660 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.253920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254385 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.254873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.255980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.256993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257476 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257860 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.257942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258409 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] role.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.258934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] role.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259055 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259599 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259747 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.259976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.260063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.260210 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.260289 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.260952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261192 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261895 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.261988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.262139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.262261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.262382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.262518 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.262626 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.262760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.external = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263767 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263857 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.263992 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.password = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264221 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.token = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264460 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.264795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265432 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.265904 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.266101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.266253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.266356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.266613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.266689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.266892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.267980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268462 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268578 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.268954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269327 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269581 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.269937 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270167 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.270822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271580 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.271992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272148 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272620 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272866 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.272957 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273103 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273361 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.273911 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274072 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274380 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274775 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.274917 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275115 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275267 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275344 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275578 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275744 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.275824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.276037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.276146 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.276768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.276859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.276997 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277318 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:08:45.277699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.277920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.278162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.278407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.278654 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.278937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.279289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.279788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.280151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.280399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.280633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.280873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.281105 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.281341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.281580 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.281818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.282064 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.282294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.282538 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.282782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.283033 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.283287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.283535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.283763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.284000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.284228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.284465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.284702 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.284943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.285179 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.285413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.285657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.285902 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.286131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.286368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.286600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.286864 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.287099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.287332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.287564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.287791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.288028 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.288282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.288511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.288754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.288996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.289237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.289468 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.289694 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.289927 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.290393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.290620 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.290881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.291126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.291369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.292143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.292389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.292617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.292863 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.293098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.293333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.293571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.293803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.294047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.294291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.294526 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.294778 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.295027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.295267 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.295501 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.295734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.295968 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.296211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.296452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.296682 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.296930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.297170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.297416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.297663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.297895 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.298137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.298387 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.298618 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.298881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.299116 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.299353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.299585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] role.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.299828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] role.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.300056 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.300304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.300548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.300792 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.301036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.301277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.301518 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.301759 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.302000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.302229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.302469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.302713 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.302976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.303219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.303639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.303871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.304117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.304360 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.304601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.304856 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.305086 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.305336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.305584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.305818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.306048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.306277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.306504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.306751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.307025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.307847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.308094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.308330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.308560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.308794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.309031 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.309276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.309511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.309762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.310009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.310245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.310325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.310477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.310559 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.310702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.310814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.310970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.311204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.311441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.311671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.311913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.312158 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.312386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.312625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.312920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.313176 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.313424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.313666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.313901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.314138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.314367 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.314602 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.314857 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.315092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.315335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.315569 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.315811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.316054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.316297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.316533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.316776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.317002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.317240 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.317471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:08:45.317636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:08:45.319376 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.342586 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.342836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.343061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.347195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.347427 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.352860 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.372197 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.372422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.401063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.409481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.454125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.454351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.456875 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.457109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519121 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.519985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.520076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.520196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.520277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.520405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.544449 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.544674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.544847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545675 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.545886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.546094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.556867 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.557034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.569728 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.569953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.570173 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.570391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.570629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.570841 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.571055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.571342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.571572 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.571790 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.572004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.572216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.572426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.572636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:08:45.589055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.589245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:08:45.589427 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.589573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.589657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:08:45.589770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:08:45.589958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590040 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:08:45.590275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.590971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.591226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.602258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.602530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.602809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.603105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.603920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.604805 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.605078 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.605354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.611820 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.613556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.615122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.615400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.615683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.616075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.616359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.616620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.616843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.616913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.617117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.617186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.617500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.617582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.617865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.617957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.618032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.618113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.618286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.618549 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.618838 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.619106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.619374 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.619652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.644339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.646203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.646477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.647794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.649638 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.650040 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.652349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.652578 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.652855 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.656689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.656959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.657292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.660216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.660495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.664531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.664812 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.665360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.665641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.665922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.666193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.666465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.667304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.667573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.670013 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.670296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.670573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.670873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.671141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.671406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.671671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.671931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.686368 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.686643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.690413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.690685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.691246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.694914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.695186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.695287 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.698812 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.699105 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.700229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.703942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.704037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.707579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.707824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.708151 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.708468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.708771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.709122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.709467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.711282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.711574 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.711851 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.712129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.712401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.712673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.728928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.729891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.730160 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.730424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.732585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.732957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.733223 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.733492 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.738345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.740102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.740380 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.741396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.743115 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.743386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.743482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.743705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.743991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.744268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.744538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.746437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.746714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.747024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.747321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.747590 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.757890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.758166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.758442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.758717 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.759019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.759292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.759564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.760851 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.761126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.761407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.761680 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.761951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.762216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.762487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.778497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.781178 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.781782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.784413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.785094 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.786694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.787778 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.788359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.788646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.788925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.789364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.791008 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.791289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.792109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.796909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.798534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.799456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.801054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.801775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.802061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.802342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.802617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.804267 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.804556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.804836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.805107 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.811881 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.812164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.812439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.814238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.814516 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.814797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.820313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.820601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.820885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.821164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.821431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.821714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.821980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.822243 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.822513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.823304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:08:45.823397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.823531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.823625 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.823806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.823889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.824079 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.824218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.824346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.824428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.824609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.824896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.825163 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.825425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.825685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.825955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.826220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.826477 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.826734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:08:45.863330 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bcb6999c0 pid: 80246 (default app) May 19 14:08:45.865511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bcb6999c0 pid: 80247 (default app) May 19 14:08:45.866673 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc010856-dfee-435d-b85d-1f8ca51314a2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:45.867001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc010856-dfee-435d-b85d-1f8ca51314a2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:45.867283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc010856-dfee-435d-b85d-1f8ca51314a2 None None] PATH_INFO: `/v3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:45.871581 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu May 19 14:08:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:08:53.898386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:53.898961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:53.899062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:53.903884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:08:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:08:53.909015 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:53.909426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:53.909557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:53.978864 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: INFO dbcounter [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] Registered counter for database keystone May 19 14:08:54.001083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG oslo_db.sqlalchemy.engines [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:08:54.007300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writer thread running {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:08:54.197175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG passlib.handlers.bcrypt [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80246) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:08:54.198113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG passlib.handlers.bcrypt [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80246) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:08:54.252701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:08:54.254279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:08:54.376107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:08:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 14:08:54.530711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:54.599845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: INFO dbcounter [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] Registered counter for database keystone May 19 14:08:54.621509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG oslo_db.sqlalchemy.engines [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:08:54.627759 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writer thread running {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:08:54.747817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695633a-d367-4b9d-bd2a-0a606ad60898 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:08:54.752058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e8a212331754df2acc9d3192f9b6ccc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:08:54.752725 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:54.753010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:54.753288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:54.761879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:08:54.813958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:08:54.814244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e94a1-b89a-4f7f-9ea6-556099ce83a4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:08:54.824243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:08:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 14:08:54.830185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:54.845007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff15b5-d5f1-4476-a4e9-ed53edd40ab7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:08:54.849369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e8a212331754df2acc9d3192f9b6ccc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:08:54.850482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:54.850769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:54.851071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] PATH_INFO: `/v3/projects/7e8a212331754df2acc9d3192f9b6ccc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:54.852581 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e8a212331754df2acc9d3192f9b6ccc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:08:55.011514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:08:55.012162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcffbf-40ff-4c9c-a05f-8b970637b1f9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:08:55.016602 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu May 19 14:08:54 2022] GET /identity/v3/projects/7e8a212331754df2acc9d3192f9b6ccc => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:08:57.196699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a713-7a64-43af-9872-3bdf7970f92b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:57.197255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a713-7a64-43af-9872-3bdf7970f92b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:57.197255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a713-7a64-43af-9872-3bdf7970f92b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:57.201988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:08:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:08:57.207537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:57.207909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:57.208093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:57.227197 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:08:57.228701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:08:57.236367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:08:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 14:08:57.257833 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a713-7a64-43af-9872-3bdf7970f92b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:57.270433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a713-7a64-43af-9872-3bdf7970f92b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:08:57.275041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054321-e254-4d27-abc1-84b085dc06b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e8a212331754df2acc9d3192f9b6ccc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:08:57.276225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054321-e254-4d27-abc1-84b085dc06b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:57.276502 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054321-e254-4d27-abc1-84b085dc06b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:57.276769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054321-e254-4d27-abc1-84b085dc06b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:57.284439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054321-e254-4d27-abc1-84b085dc06b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:08:57.286177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054321-e254-4d27-abc1-84b085dc06b4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:08:57.294827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:08:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:08:57.299874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:57.308648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0809b-43e5-4e1d-aaeb-c02395ca5649 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:08:57.312926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03970-dc65-4309-b145-25248074887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e8a212331754df2acc9d3192f9b6ccc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:08:57.313773 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03970-dc65-4309-b145-25248074887e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:57.314054 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03970-dc65-4309-b145-25248074887e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:57.314327 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03970-dc65-4309-b145-25248074887e admin admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:57.315719 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03970-dc65-4309-b145-25248074887e admin admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:08:57.317502 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03970-dc65-4309-b145-25248074887e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:08:57.319082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu May 19 14:08:57 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:08:59.577498 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3941e2-784b-4b37-94da-939888159eba None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:59.578022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3941e2-784b-4b37-94da-939888159eba None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:59.578115 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3941e2-784b-4b37-94da-939888159eba None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:59.579444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:08:59.584876 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:59.585255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:59.585437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:59.602027 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:08:59.603229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:08:59.612421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d477-cb5c-4eb0-8115-39f5e85b72e7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:59.612712 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d477-cb5c-4eb0-8115-39f5e85b72e7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:59.612988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d477-cb5c-4eb0-8115-39f5e85b72e7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:59.614326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:08:59.619168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:59.619981 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:59.620254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:59.659242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG passlib.handlers.bcrypt [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80247) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:08:59.659592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG passlib.handlers.bcrypt [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80247) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:08:59.686777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:08:59.706650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:08:59.708482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:08:59.709339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:59.733516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:08:59.807879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:08:59.821115 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768dfe3-af19-4dea-91c7-0e2b1a7c54a5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:08:59.836748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:59.857800 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:08:59.858605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:59.858918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:59.859199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:59.870512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:08:59.881784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:08:59.882836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:08:59.883663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:08:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:08:59.888926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:08:59.942381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b01052-4fec-4125-b81a-f58d022e058b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:08:59.944735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:08:59.974351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:08:59.984985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:08:59.985891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:08:59.986183 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:08:59.986463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:08:59.993281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5145a-6726-4df8-9d77-883ce705c521 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:00.031272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:00.031942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:00.032227 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:00.032502 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:00.033255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:00.033559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.034982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.047257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:08:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:00.052500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:00.053992 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.055606 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.153871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a054d6-7d45-414d-adaf-8a0ee86e61b1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:00.157349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:09:00.162954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:00.165604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:00.189174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:00.190046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:00.190330 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:00.190605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:00.191834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.193353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.195128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:00 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:00.200176 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:00.214441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:00.258652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1ee0-6e8d-469a-8561-b82736bacc59 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:00.292202 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:00.293081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:00.293358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:00.293651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:00.298684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcf648-ff96-4982-bec5-748420abb39a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:00.312421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.313876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.331773 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:00.332560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:00.332841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:00.333115 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:00.334277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:09:00.334879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:00.335657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:00.336438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:09:00.336438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:09:00.336438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:09:00.336438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:00.336636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.336700 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:00.341833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:00.341972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:00.342742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:00.403475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:00.425024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:00.448324 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41d8f-1f31-416c-8ebb-891198b9a881 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:00.448509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5b1c-f144-4f22-bcd4-d87f1c0a6bf5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:00.482752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:00.483440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:00.483722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:00.484002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:00.484467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:00.484724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:00.485029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.485112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:00.485386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:00.485665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:00.486469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3703c-ab99-4146-817f-15cb235c6cb6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.486564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.domain.id=default, user.id=1630473ba96b4b308be7b0443882c517) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:00.486814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:00.488245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa453a2-d7fc-4e12-9a48-536aec2ce7f1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:00.494871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:09:00 2022] GET /identity/v3/role_assignments?user.id=1630473ba96b4b308be7b0443882c517&scope.domain.id=default&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:00.504085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:02.966317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ac5f-adf5-4a23-8da8-5b26d104eec0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:02.967402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ac5f-adf5-4a23-8da8-5b26d104eec0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:02.967908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ac5f-adf5-4a23-8da8-5b26d104eec0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:02.969506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:02.975008 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:02.975863 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:02.976386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.000149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:03.001699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:03.147493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb97f6-c154-452f-bec9-c9457d8d741a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:03.148120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb97f6-c154-452f-bec9-c9457d8d741a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:03.148622 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb97f6-c154-452f-bec9-c9457d8d741a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.150198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 13/23] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:03.156688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:03.167843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:03.168484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.207842 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:03.209081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:03.249196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 11/24] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:03.285704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:03.361307 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 14/25] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:03.395152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:03.403153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:03.523500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072da61-6850-4ad7-b735-3dda22f01069 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:03.595125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:03.603731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:03.604661 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:03.604940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:03.605210 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.633478 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6aa257-9ff2-40ac-8714-faea67dd719c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:03.635853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:03.644908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:03.646010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:03.646774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 12/26] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:03.663826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:03.699509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:03.700325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:03.700611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:03.700885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.711815 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:03.713343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:09:03.752193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:03.754210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:03.756352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:09:03.756352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:09:03.756352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:09:03.756352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:03.756352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 15/27] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:03.760661 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:03.895962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4911-5d44-4f53-a734-6eeb555a5d13 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:03.911193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:03.956064 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:03.957108 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:03.957585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:03.958085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.959060 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:03.959682 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:03.961255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ac1a5-9329-4131-817a-45a448346358 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:03.972923 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba1bb6-0788-41f6-9f3b-4369ee407181 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:03.974464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 13/28] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:03.975984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f3e4-b3da-4a16-a918-7c33ed03d7c0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:03.976856 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f3e4-b3da-4a16-a918-7c33ed03d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:03.977332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f3e4-b3da-4a16-a918-7c33ed03d7c0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:03.979593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 14/29] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:03.980652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f3e4-b3da-4a16-a918-7c33ed03d7c0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:04.055415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:04.080102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.080791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.081074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.081545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.082428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:04.082972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.084515 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94b090-265e-44d7-8a88-ba9ab7a47560 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.100599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f3e4-b3da-4a16-a918-7c33ed03d7c0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:04.119567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 16/30] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:04.121228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.121714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.122118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.142845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:04.144259 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:04.147234 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56467c-82cb-4e0c-9554-422d3362a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.149102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56467c-82cb-4e0c-9554-422d3362a76d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.149487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56467c-82cb-4e0c-9554-422d3362a76d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.149865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56467c-82cb-4e0c-9554-422d3362a76d None admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.152212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56467c-82cb-4e0c-9554-422d3362a76d None admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.153829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56467c-82cb-4e0c-9554-422d3362a76d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.156179 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 15/31] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:03 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:04.157611 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5a26-8de0-4d95-a0d2-cfa3756bce0f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.158089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5a26-8de0-4d95-a0d2-cfa3756bce0f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.158575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5a26-8de0-4d95-a0d2-cfa3756bce0f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.160002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 16/32] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:04.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5a26-8de0-4d95-a0d2-cfa3756bce0f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:04.215013 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:04.237066 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 17/33] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:04.238258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:04.296980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5a26-8de0-4d95-a0d2-cfa3756bce0f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:04.335901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.336844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.337383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.338380 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.339311 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.341297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.350319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39786e4-aea1-45d7-a72f-3cd739f1edfe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:04.371880 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:04.393596 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988505b-b62a-40f4-b22b-4030330c6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.394736 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988505b-b62a-40f4-b22b-4030330c6c85 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.395175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988505b-b62a-40f4-b22b-4030330c6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.395852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988505b-b62a-40f4-b22b-4030330c6c85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.397381 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988505b-b62a-40f4-b22b-4030330c6c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.399139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988505b-b62a-40f4-b22b-4030330c6c85 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.401546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 18/34] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:04.403097 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.403580 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.404137 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.424035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:04.425567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:04.496346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 19/35] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:04.497604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:04.506942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 17/36] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/projects => generated 301 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:04.506942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:04.623375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:04.648521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feff82-5b28-425b-8562-8ad03c160889 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:04.668797 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a145-c0a5-44b6-9c75-4426ee9d2471 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:04.687394 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:04.707871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd8829-adfe-41fb-bda8-f98b18725cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.708754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd8829-adfe-41fb-bda8-f98b18725cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.709045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd8829-adfe-41fb-bda8-f98b18725cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.709327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd8829-adfe-41fb-bda8-f98b18725cb0 None admin] PATH_INFO: `/v3/domains/default/users/1630473ba96b4b308be7b0443882c517/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.712113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd8829-adfe-41fb-bda8-f98b18725cb0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1630473ba96b4b308be7b0443882c517, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.714296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd8829-adfe-41fb-bda8-f98b18725cb0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.716789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375f1e7-ee36-4e8f-90ba-7a610d2586e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.717733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f1e7-ee36-4e8f-90ba-7a610d2586e6 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.718383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f1e7-ee36-4e8f-90ba-7a610d2586e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.718899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f1e7-ee36-4e8f-90ba-7a610d2586e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.719978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375f1e7-ee36-4e8f-90ba-7a610d2586e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.721870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375f1e7-ee36-4e8f-90ba-7a610d2586e6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.735036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 18/37] 10.222.0.71 () {58 vars in 1361 bytes} [Thu May 19 14:09:04 2022] PUT /identity/v3/domains/default/users/1630473ba96b4b308be7b0443882c517/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:04.736651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073317a-5879-42d0-8284-4f2529f073da None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.736944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073317a-5879-42d0-8284-4f2529f073da None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.737219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073317a-5879-42d0-8284-4f2529f073da None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.738731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 19/38] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:04.739324 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073317a-5879-42d0-8284-4f2529f073da None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:04.863318 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073317a-5879-42d0-8284-4f2529f073da None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:04.866011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 20/39] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/roles => generated 219 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:04.867554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.867851 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.868132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.887817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:04.889459 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:04.914657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d1e99-f955-46d7-9625-890d86a40677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:04.915747 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d1e99-f955-46d7-9625-890d86a40677 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.916278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d1e99-f955-46d7-9625-890d86a40677 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.916748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d1e99-f955-46d7-9625-890d86a40677 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.917846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d1e99-f955-46d7-9625-890d86a40677 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:04.919751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d1e99-f955-46d7-9625-890d86a40677 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:04.938652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 20/40] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/roles => generated 225 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:04.940657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ca20-2efb-4c7e-88af-e336b3f8654f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.941274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ca20-2efb-4c7e-88af-e336b3f8654f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.941791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ca20-2efb-4c7e-88af-e336b3f8654f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.943703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 21/41] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:04.951021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:04.951710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:04.952193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:04.973403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:04.975800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:04.978888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:04.984186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 21/42] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:05.013041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:05.070333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 22/43] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:05.112784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:05.140299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad9034-5f41-4764-9534-432eaee1a8c7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:05.144190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:05.195101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342270-e128-408a-88df-a11287968238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:05.196353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342270-e128-408a-88df-a11287968238 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:05.196353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342270-e128-408a-88df-a11287968238 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:05.196353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342270-e128-408a-88df-a11287968238 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:05.198488 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31342270-e128-408a-88df-a11287968238 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:05.201528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31342270-e128-408a-88df-a11287968238 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:05.219339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 22/44] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:09:05 2022] POST /identity/v3/roles => generated 223 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:09:05.242029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca5ba-c8cd-4ab4-a597-fb0af7033825 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:05.284527 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1e4d-a5e2-4cca-9346-b18fbbe9ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:05.285343 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1e4d-a5e2-4cca-9346-b18fbbe9ee7c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:05.285682 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1e4d-a5e2-4cca-9346-b18fbbe9ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:05.285960 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1e4d-a5e2-4cca-9346-b18fbbe9ee7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:05.287289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1e4d-a5e2-4cca-9346-b18fbbe9ee7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:05.288834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1e4d-a5e2-4cca-9346-b18fbbe9ee7c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:05.290577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 23/45] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:05.296496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342270-e128-408a-88df-a11287968238 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:05.428252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342270-e128-408a-88df-a11287968238 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:05.464739 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd710042-9073-46f2-a20d-c1aae0bc6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:05.465643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd710042-9073-46f2-a20d-c1aae0bc6371 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:05.466161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd710042-9073-46f2-a20d-c1aae0bc6371 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:05.466450 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd710042-9073-46f2-a20d-c1aae0bc6371 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:05.467220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd710042-9073-46f2-a20d-c1aae0bc6371 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:05.468686 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd710042-9073-46f2-a20d-c1aae0bc6371 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:05.497153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 23/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:09:05 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:07.171447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ece060-f712-4539-bba3-f706221a35bd None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.171966 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ece060-f712-4539-bba3-f706221a35bd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.172048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ece060-f712-4539-bba3-f706221a35bd None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.173375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 24/47] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:07.178682 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.179101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.179272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.196181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:07.197390 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:07.208266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:07.272538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 24/48] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:07.295224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ece060-f712-4539-bba3-f706221a35bd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.304096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:07.395849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ece060-f712-4539-bba3-f706221a35bd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:07.433402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:07.434205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.434493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.434775 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.444916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:07.453139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:07.454128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:07.455021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 25/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:07.459939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.560552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83d1f-49b4-4f63-bca1-1e9443b4c144 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:07.594541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:07.595256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.595547 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.595828 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.596598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:07.596909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:07.598340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fe8bc-fac0-414a-b18d-19bd0896caf4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:07.607665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 25/50] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:07.612902 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.677811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:07.693992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015491-b4af-4e2d-8e6e-409df75c88f7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.694208 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015491-b4af-4e2d-8e6e-409df75c88f7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.694494 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015491-b4af-4e2d-8e6e-409df75c88f7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.695909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 26/51] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:07.701447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.701862 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.702148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.713905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9dbd5-9e90-45f1-998b-fc098326bb24 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:07.719062 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:07.720277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:07.722225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:07.747801 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:07.748667 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.748949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.749224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.750400 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:07.751873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:07.753495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 26/52] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:07 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:07.758737 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.789953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 27/53] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:07.812555 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.855716 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d32dd-1719-41ed-b718-5c417433fcfa None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:07.889131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:07.889912 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.890195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.890472 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.891685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:07.893131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:07.894732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 27/54] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:07.901106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.903696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:07.909555 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204bef8-1a18-406a-a00b-ebb0d1710ef1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:07.943255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:07.944099 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:07.944337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:07.944614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:07.945811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:07.947925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:07.949552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 28/55] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:07.954955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:07.963741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:08.002156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3337a-55af-4dd9-9fcd-36bff1e86392 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:08.036319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:08.036975 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:08.037266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:08.037546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:08.038390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.domain.id=default, user.id=1630473ba96b4b308be7b0443882c517) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:08.038703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:08.040168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce59b91-ea41-4cac-9d9d-76ba613b1ba9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 28/56] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:09:07 2022] GET /identity/v3/role_assignments?user.id=1630473ba96b4b308be7b0443882c517&scope.domain.id=default&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:08.055443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4841d-b6fe-4457-82b7-8eb899467902 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:08.093853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad856c72-6d78-41c1-b03e-7320c46183e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:08.094655 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad856c72-6d78-41c1-b03e-7320c46183e4 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:08.094969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad856c72-6d78-41c1-b03e-7320c46183e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:08.095248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad856c72-6d78-41c1-b03e-7320c46183e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:08.095976 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad856c72-6d78-41c1-b03e-7320c46183e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:08.097483 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad856c72-6d78-41c1-b03e-7320c46183e4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:08.128104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 29/57] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:09:07 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:09:10.338459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5c09a-e431-495d-b8dd-9a0ac049e29c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:10.339034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5c09a-e431-495d-b8dd-9a0ac049e29c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:10.339034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5c09a-e431-495d-b8dd-9a0ac049e29c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:10.340408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 29/58] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:10.345562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:10.345928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:10.346131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:10.363213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:10.364418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:10.416671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:10.431119 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 30/59] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:10.456038 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5c09a-e431-495d-b8dd-9a0ac049e29c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:10.521308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:10.555607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5c09a-e431-495d-b8dd-9a0ac049e29c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:10.588181 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122466-e63e-490b-9ac9-b929eb07e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:10.589012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122466-e63e-490b-9ac9-b929eb07e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:10.589247 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122466-e63e-490b-9ac9-b929eb07e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:10.589524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122466-e63e-490b-9ac9-b929eb07e4c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:10.590685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122466-e63e-490b-9ac9-b929eb07e4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:10.592142 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122466-e63e-490b-9ac9-b929eb07e4c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:10.593731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 30/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:10.599032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:10.693609 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041023d7-a991-4031-8041-c9e52d878a9f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:10.726240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf04e9-f76c-4121-9dfe-66b569648fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:10.726925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf04e9-f76c-4121-9dfe-66b569648fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:10.727209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf04e9-f76c-4121-9dfe-66b569648fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:10.727486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf04e9-f76c-4121-9dfe-66b569648fd1 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:10.728220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf04e9-f76c-4121-9dfe-66b569648fd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:10.729646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf04e9-f76c-4121-9dfe-66b569648fd1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:10.753337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 31/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:10 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:14.205406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153ab1-8498-4b11-908b-54f200f8ab96 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.205406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153ab1-8498-4b11-908b-54f200f8ab96 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.205406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153ab1-8498-4b11-908b-54f200f8ab96 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.205406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 31/62] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:14.211164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708e5a-c188-49e5-8061-e931c18196df None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.211983 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708e5a-c188-49e5-8061-e931c18196df None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.212462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708e5a-c188-49e5-8061-e931c18196df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.219715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a4604-987e-4322-a040-eafc41499c27 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.220322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a4604-987e-4322-a040-eafc41499c27 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.220818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a4604-987e-4322-a040-eafc41499c27 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.222368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 32/63] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:14.236940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.237544 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.238025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.239143 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-76708e5a-c188-49e5-8061-e931c18196df None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:14.240560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-76708e5a-c188-49e5-8061-e931c18196df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:14.267810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:14.269294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:14.291512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:14.351626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 33/64] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:14.364340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 32/65] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:14.401457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708e5a-c188-49e5-8061-e931c18196df None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:14.404306 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:14.506965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:14.538397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708e5a-c188-49e5-8061-e931c18196df None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:14.554112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d09cd-6dd8-4ab4-8d29-0bdb956c9b2f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:14.589000 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bcfc2-9ee9-4dff-bacc-966bd72d4e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:14.590277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bcfc2-9ee9-4dff-bacc-966bd72d4e03 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.590568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bcfc2-9ee9-4dff-bacc-966bd72d4e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.590863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bcfc2-9ee9-4dff-bacc-966bd72d4e03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.600536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d2e4c-7e64-41d3-b3e5-12f9118a0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:14.601519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d2e4c-7e64-41d3-b3e5-12f9118a0903 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.601956 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d2e4c-7e64-41d3-b3e5-12f9118a0903 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.602233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d2e4c-7e64-41d3-b3e5-12f9118a0903 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.602603 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bcfc2-9ee9-4dff-bacc-966bd72d4e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d23bcfc2-9ee9-4dff-bacc-966bd72d4e03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:14.610364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:14.611444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:14.612196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 33/66] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:14.613497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728e23b-1f02-46fa-a17a-3673251b8207 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.613497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728e23b-1f02-46fa-a17a-3673251b8207 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.613664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728e23b-1f02-46fa-a17a-3673251b8207 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.615146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 34/67] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:14.621742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d263-3490-4d4e-a4c3-f3c0fceea15b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.621742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d263-3490-4d4e-a4c3-f3c0fceea15b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.621742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d263-3490-4d4e-a4c3-f3c0fceea15b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.621988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d2e4c-7e64-41d3-b3e5-12f9118a0903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:14.622076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 35/68] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:14.622076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d263-3490-4d4e-a4c3-f3c0fceea15b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e63d2e4c-7e64-41d3-b3e5-12f9118a0903 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:14.628024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:14.628886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:14.629624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:14.630428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc7d01-910a-4921-ac10-45726865a0c2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.630890 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc7d01-910a-4921-ac10-45726865a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.631308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc7d01-910a-4921-ac10-45726865a0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.649853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-eebc7d01-910a-4921-ac10-45726865a0c2 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:14.651770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-eebc7d01-910a-4921-ac10-45726865a0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:14.661826 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:14.726774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 35/70] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:14.729262 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.729740 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.730377 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.745964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d263-3490-4d4e-a4c3-f3c0fceea15b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:14.751155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:14.752346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:14.783027 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:14.783632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.783920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.784189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.784948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:14.785322 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:14.786726 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:14.795946 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 36/71] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:14.797032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:14.806040 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:14.831242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 36/72] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:14.831242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:14.908888 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:14.916771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b014-b668-4c07-b791-255c095dcf1e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:14.939375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5214-e791-4a0a-bbac-507909e402c9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:14.955934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:14.956727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.957137 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.957465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.958399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:14.958934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:14.960586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:14.970505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 37/73] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:14.971492 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:14.979909 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:14.980719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:14.981002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:14.981282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:14.991853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:14.999928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:15.000770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:15.001519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 37/74] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:15.002761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.049981 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.082576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376f824-50f3-47df-b493-e0a8305e8e1c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.105024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9a75f-db3e-447e-9f36-06929105f00c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.116167 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61011-a768-46b6-8472-026459544509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.117047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61011-a768-46b6-8472-026459544509 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.117344 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61011-a768-46b6-8472-026459544509 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.117610 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61011-a768-46b6-8472-026459544509 None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.130637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61011-a768-46b6-8472-026459544509 None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.132154 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61011-a768-46b6-8472-026459544509 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.133803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 38/75] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:14 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.135132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61011-a768-46b6-8472-026459544509 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.142830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.143804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.144086 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.144358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.153012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.155867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:15.163571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:15.164519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:15.165260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 38/76] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:15.165921 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.236618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61011-a768-46b6-8472-026459544509 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.264337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3926ce-ade8-434b-87cd-7c724b5db38f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.266944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.271132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30889-338c-4d44-baf5-fb16808a0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.272024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30889-338c-4d44-baf5-fb16808a0fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.272318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30889-338c-4d44-baf5-fb16808a0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.272599 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30889-338c-4d44-baf5-fb16808a0fa3 None admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.273801 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30889-338c-4d44-baf5-fb16808a0fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.275869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30889-338c-4d44-baf5-fb16808a0fa3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.277511 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 39/77] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.278695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae698-c703-4635-8302-0e1142b8bf02 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.279009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae698-c703-4635-8302-0e1142b8bf02 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.279285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae698-c703-4635-8302-0e1142b8bf02 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.280806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 40/78] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:15.281529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae698-c703-4635-8302-0e1142b8bf02 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.301610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.302219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.302507 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.302779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.303557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:15.303865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.305253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.313355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 39/79] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.314147 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.368803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.385336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae698-c703-4635-8302-0e1142b8bf02 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.413857 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a8b5-0284-48bc-b70b-7207a43aa943 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.419952 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec234-1f44-479f-8068-366457d4f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.420614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec234-1f44-479f-8068-366457d4f436 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.420900 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec234-1f44-479f-8068-366457d4f436 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.421178 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec234-1f44-479f-8068-366457d4f436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.448802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.449483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.449767 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.450042 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.450782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:15.451182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.452564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.460578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 40/80] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.461171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.489132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.492350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec234-1f44-479f-8068-366457d4f436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.494838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec234-1f44-479f-8068-366457d4f436 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.565588 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2629b3-1d88-48e7-b007-9ca126ee9bf8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.583219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.598695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.599376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.599514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 41/81] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:15.599953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.600233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.604991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.605281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.605559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.622090 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:15.623311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:15.667876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.669412 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.688001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 42/82] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:15.688828 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.697728 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.774211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 41/83] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:15.774211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.802275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33b2b7-020c-4683-afa8-d4c17ddf437f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.818637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.839325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.840204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.840590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.840878 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.842071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.843577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.845222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 43/84] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.845991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.876213 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cccc4-0e15-40db-adf1-bd4da12cd4f7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.902645 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:15.910293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.911184 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.911471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.911748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.912927 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.914374 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.916603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 42/85] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.917372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:15.946365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c262-6c13-4dc8-9cee-a97899eaf2fd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:15.980841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:15.981709 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:15.981999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:15.982288 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:15.983499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:15.984950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:15.986684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 44/86] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:15.987480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.017416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574695dc-c8a4-4a8b-9564-43a4252ca219 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.035982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.050932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.051720 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.052002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.052278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.053490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.054912 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.057090 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 43/87] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:16.057862 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.087157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2560d-78c7-49a4-a04b-a0fb89d00f79 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.122091 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.122989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.123270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.123544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.124092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.124727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.126216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.128004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 45/88] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:15 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:16.132804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.168053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f1f9-70a1-4d61-a1b1-3d2361a055eb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.203067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.203690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.203973 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.204249 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.231017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdc47a-0a67-41e5-adb5-309310d610b4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.248224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.266237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.266923 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.267210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.267488 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.274468 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.275961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.333427 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.334933 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.335128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.374307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 44/89] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:16.375090 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.446481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 46/90] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:16.447953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.466406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.483653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31377-066b-4963-8d09-d80109d5f407 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.517200 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.517855 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.518143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.518424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.519294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=89914458b95048e68ebfaa2a619ef7b0) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:16.519611 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.521332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.526750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 45/91] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/role_assignments?user.id=89914458b95048e68ebfaa2a619ef7b0&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:16.527553 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.557750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.564410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc448b9-0cd5-4b6d-a11f-f16f2f98d242 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.606351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.607247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.607537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.607820 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.608565 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.610077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.633294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 47/92] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:16 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:16.633903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.663537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107eb05-0dab-4d66-be02-0e91a3a344a5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.717916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.719278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.719577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.719860 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.720918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=1630473ba96b4b308be7b0443882c517) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:16.721419 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.723111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.733500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 46/93] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/role_assignments?user.id=1630473ba96b4b308be7b0443882c517&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:16.733500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.755281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.817854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd641b-9ff2-442b-8ab6-e76ba07e1be1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.902321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.903162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.903452 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.903729 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.905001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.906494 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.908494 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 48/94] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:16.914208 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:16.923488 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:16.939542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165579fd-ffd7-4874-b7dc-b35590dd33d4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:16.989305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:16.990183 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:16.990464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:16.990739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] PATH_INFO: `/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:16.991983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=57f70a53ff3d4d6784a24c7c498f0ccc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:16.993959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:16.995858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 47/95] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:17.001917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:17.048128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556e5b-e377-4434-8b34-7610d10ec362 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:17.102812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:17.102812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:17.102812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:17.102812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:17.103189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] RBAC: Adding query filter params (role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=89914458b95048e68ebfaa2a619ef7b0) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:17.103189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:17.103189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e8f03-ddd9-46bd-9720-8545eead68b3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:17.111275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 49/96] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:16 2022] GET /identity/v3/role_assignments?user.id=89914458b95048e68ebfaa2a619ef7b0&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:17.136161 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b56b3-1c36-4d31-95fb-bdb8d426d7a8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:17.183649 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:17.184328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:17.184615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:17.184893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:17.185757 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=57f70a53ff3d4d6784a24c7c498f0ccc, user.id=89914458b95048e68ebfaa2a619ef7b0) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:17.186070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:17.187653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a46b4-e27b-4e4d-9324-6219ee5baa02 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:17.194716 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 48/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:17 2022] GET /identity/v3/role_assignments?user.id=89914458b95048e68ebfaa2a619ef7b0&scope.project.id=57f70a53ff3d4d6784a24c7c498f0ccc&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:19.258298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ede1-ab43-4b1e-8a4b-1e11e9e73a5b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:19.258970 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ede1-ab43-4b1e-8a4b-1e11e9e73a5b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:19.258970 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ede1-ab43-4b1e-8a4b-1e11e9e73a5b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:19.260424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 50/98] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:19.266142 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:19.266634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:19.266712 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:19.287381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:19.288572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:19.311865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:19.369147 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 49/99] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:19.407096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ede1-ab43-4b1e-8a4b-1e11e9e73a5b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:19.423238 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:19.563169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ede1-ab43-4b1e-8a4b-1e11e9e73a5b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:19.612415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:19.613240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:19.613526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:19.613804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:19.628930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:19.637248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:19.638223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:19.639032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 51/100] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:19.646117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:19.785134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde98d8-56be-4b25-887a-468b1afaf05f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:19.832141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:19.832746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:19.833030 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:19.833305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:19.834062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:19.834370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:19.835771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:19.850555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 50/101] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:19.856341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:19.980630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:20.008110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5f717-35d4-41eb-8479-3570d958cc28 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.053410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7aab-3eae-4225-a5c9-89b7e0be7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.054664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7aab-3eae-4225-a5c9-89b7e0be7b47 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.055173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7aab-3eae-4225-a5c9-89b7e0be7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.055666 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7aab-3eae-4225-a5c9-89b7e0be7b47 None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.063580 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c7aab-3eae-4225-a5c9-89b7e0be7b47 None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:20.065323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c7aab-3eae-4225-a5c9-89b7e0be7b47 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:20.067435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 52/102] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:19 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:20.073801 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:20.105214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:20.215906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12b04-e7a6-47c4-83cc-0f397a818e53 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.216549 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12b04-e7a6-47c4-83cc-0f397a818e53 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.217030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12b04-e7a6-47c4-83cc-0f397a818e53 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.219351 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0c1c-f96c-4a92-8907-bdc39310806a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.219909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 53/103] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:20.228386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087e23-5329-47cc-9c0a-ab5bc1ef76b6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.228979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087e23-5329-47cc-9c0a-ab5bc1ef76b6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.229467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087e23-5329-47cc-9c0a-ab5bc1ef76b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.262039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-85087e23-5329-47cc-9c0a-ab5bc1ef76b6 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:20.263378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-85087e23-5329-47cc-9c0a-ab5bc1ef76b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:20.266100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.267012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.267501 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.267572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.268825 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:20.270548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:20.273405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 51/104] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:20 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:20.283654 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:20.372399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 54/105] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:20.373778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330512f-7a07-465f-9abe-9a514a8a878a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.374076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330512f-7a07-465f-9abe-9a514a8a878a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.374356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330512f-7a07-465f-9abe-9a514a8a878a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.375798 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 55/106] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:20.380958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.381250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.381533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.382173 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:20.401855 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9578ee-aaff-44dd-90ce-4366a1b109c9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.410689 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:20.412190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:20.438449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.439360 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.439646 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.439972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/89914458b95048e68ebfaa2a619ef7b0/roles/ad000b61baa1488c8cbae9dd0db42708` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.442283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] RBAC: Authorizing `identity:create_grant(project_id=6df3fcc135b54d5c8e2340a0237d6908, user_id=89914458b95048e68ebfaa2a619ef7b0, role_id=ad000b61baa1488c8cbae9dd0db42708)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:20.443810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:20.465034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 52/107] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:20 2022] PUT /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/89914458b95048e68ebfaa2a619ef7b0/roles/ad000b61baa1488c8cbae9dd0db42708 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:09:20.466075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:20.490171 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:20.503882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 56/108] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:20.528141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:20.610149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43b0a-1e95-4671-ad22-3882f54dd2ac None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.658277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.659027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.659291 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531b37a-d321-43a5-b3e4-46251f9db978 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.659418 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.659577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.672943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:20.681816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:20.682678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:20.683463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:20.685850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 53/109] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:20.691728 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:20.704295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:20.723895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5efc5-cd45-45e7-b94f-0980fa02d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.726486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5efc5-cd45-45e7-b94f-0980fa02d55f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.726819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5efc5-cd45-45e7-b94f-0980fa02d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.727126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5efc5-cd45-45e7-b94f-0980fa02d55f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.765012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5efc5-cd45-45e7-b94f-0980fa02d55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a3a5efc5-cd45-45e7-b94f-0980fa02d55f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:20.783286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:20.784205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:20.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 57/110] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:20.786108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80de5-6a92-4bde-a876-5412cc5db31b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.786207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80de5-6a92-4bde-a876-5412cc5db31b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.786492 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80de5-6a92-4bde-a876-5412cc5db31b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.791291 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 58/111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:20.794338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80de5-6a92-4bde-a876-5412cc5db31b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:20.863618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:20.878221 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ef9ec-9a90-450a-b8fc-fe6b27ce4186 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.913259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.913461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80de5-6a92-4bde-a876-5412cc5db31b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:20.913847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.914134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.914411 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.915264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:20.916098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:20.917482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a5341-a26a-40d4-a352-aa687a278a1a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:20.925932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 54/112] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:20.927204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.927475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.927752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.944681 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:20.945887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:20.956834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:20.957541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.957819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.958101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.958913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:20.959213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:20.960608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ca75-c9a5-4776-865e-6a7c347001bd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:20.970825 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 59/113] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:20.972078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3b45-b97b-4116-8662-a072336da81c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.972373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3b45-b97b-4116-8662-a072336da81c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.972652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3b45-b97b-4116-8662-a072336da81c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.973895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 60/114] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:20.978556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb52d3e-1cd5-4f87-bace-b111f82a27c4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:20.978556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb52d3e-1cd5-4f87-bace-b111f82a27c4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:20.978556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb52d3e-1cd5-4f87-bace-b111f82a27c4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:20.978556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 61/115] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:20.978916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb52d3e-1cd5-4f87-bace-b111f82a27c4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.013686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.022525 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 55/116] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:21.023413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.094312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb52d3e-1cd5-4f87-bace-b111f82a27c4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.112561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.127802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872b22-2886-435c-ae33-b96cda2c53b7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.131187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a21dcd-939b-402b-bde4-9b3ee469a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.132062 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a21dcd-939b-402b-bde4-9b3ee469a2ed None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.132341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a21dcd-939b-402b-bde4-9b3ee469a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.132614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a21dcd-939b-402b-bde4-9b3ee469a2ed None admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.133802 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a21dcd-939b-402b-bde4-9b3ee469a2ed None admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.135817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a21dcd-939b-402b-bde4-9b3ee469a2ed None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.137659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 62/117] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:20 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:21.138594 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.138901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.139174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.156961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:21.158139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:21.167955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7100e-8c5d-439f-9132-eede17f0a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.169189 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7100e-8c5d-439f-9132-eede17f0a38b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.169572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7100e-8c5d-439f-9132-eede17f0a38b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.170194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7100e-8c5d-439f-9132-eede17f0a38b None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.171719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7100e-8c5d-439f-9132-eede17f0a38b None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.173977 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7100e-8c5d-439f-9132-eede17f0a38b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.178942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 56/118] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:21.180198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.180810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.180810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.197769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:21.199109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:21.231256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 63/119] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:21.231893 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.273835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.284322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 57/120] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:21.285333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.353047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f479730-2e9c-4757-9bd4-243a6c4cec77 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.367868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.390375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32ccdf-2568-466d-ad2a-207e2ea0667b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.393984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.393984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.393984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.394265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.411252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:21.419148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:21.420034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:21.420789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 64/121] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:21.421408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.438573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.439707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.440160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.440440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.441735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.443266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.445243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 58/122] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:21.445736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.513924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.530944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf2883-2ec3-4375-9e3a-c066200a67ce None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.556227 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea266532-60e0-484c-85b4-df0e49445268 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.568540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.569810 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.570306 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.570771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] PATH_INFO: `/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.572852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] RBAC: Authorizing `identity:get_project(project_id=57f70a53ff3d4d6784a24c7c498f0ccc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.574439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.576428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 65/123] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:21.581528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.594071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.595038 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.595316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.595593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.606170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:21.614261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:21.615171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:21.615928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 59/124] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:21.617300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.631823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.691175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aafaa-fade-46dc-ab50-81e75bc78c19 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.724074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.724866 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.725150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.725425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.726046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fbed-f078-4b60-98a1-cad6823c31dc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.726587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.728168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.729819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 66/125] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:21.734969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.751220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.767061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.768255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.768773 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.769319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.771396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:21.771923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.773490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.787583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 60/126] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:21.787583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.844574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ddca-e298-48d3-953d-2ab16775a174 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.856518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:21.882068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.882999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.883292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.883575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/1630473ba96b4b308be7b0443882c517/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.885572 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6df3fcc135b54d5c8e2340a0237d6908, user_id=1630473ba96b4b308be7b0443882c517, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.887053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.894422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad63f-9400-4e0e-9d2c-796c5d6c08ef None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:21.903037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 67/127] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:21 2022] PUT /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/1630473ba96b4b308be7b0443882c517/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:21.904200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:21.948714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:21.949639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:21.949993 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:21.950392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] PATH_INFO: `/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc/users/89914458b95048e68ebfaa2a619ef7b0/roles/ad000b61baa1488c8cbae9dd0db42708` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:21.954009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] RBAC: Authorizing `identity:create_grant(project_id=57f70a53ff3d4d6784a24c7c498f0ccc, user_id=89914458b95048e68ebfaa2a619ef7b0, role_id=ad000b61baa1488c8cbae9dd0db42708)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:21.955637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:21.973710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 61/128] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:21 2022] PUT /identity/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc/users/89914458b95048e68ebfaa2a619ef7b0/roles/ad000b61baa1488c8cbae9dd0db42708 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:21.974677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:22.039843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:22.084714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7852ca-33f7-4e4c-96f6-16661891ede9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.112646 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da3fe1-98bd-467d-aedb-d9f10fda7f8f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.152963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.153641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.153926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.154204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.154959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.156528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.169342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.170063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.170352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.170631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.171807 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:22.172395 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.174109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.185376 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 68/129] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:22.186373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 62/130] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:09:21 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:22.186489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:22.191947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:22.266058 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:22.367944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ba090-0606-4a6f-a91e-5405e4e78e85 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.373334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:22.380132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17b4f4-e677-4883-985c-3981e3eeddaf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.423593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.424462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.424901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.425309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] PATH_INFO: `/v3/users/53d8fca727454e1483702a0ad917e9e4` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.429463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.430635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.439491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.440106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.441477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] RBAC: Authorizing `identity:get_user(user_id=53d8fca727454e1483702a0ad917e9e4)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.442466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.443147 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.444421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.446071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 69/131] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:22 2022] GET /identity/v3/users/53d8fca727454e1483702a0ad917e9e4 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:22.448437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 63/132] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:22 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:22.453446 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:22.457723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:22.564855 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:22.576270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dbe14-5c8d-4991-8648-056553fab44a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.626972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bd40-0148-440d-bd33-403b63ae9acf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.652896 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a339c0-eb09-4d9a-ad4c-ee2361abc4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.653933 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a339c0-eb09-4d9a-ad4c-ee2361abc4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.654423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a339c0-eb09-4d9a-ad4c-ee2361abc4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.654962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a339c0-eb09-4d9a-ad4c-ee2361abc4f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.670814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.670814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.670814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.670814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.671198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.672579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.675383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 64/133] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:22 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:22.681926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:22.717023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:22.805731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9099c-fdbf-44fe-8d08-66e6a9fb0357 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:22.806854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a339c0-eb09-4d9a-ad4c-ee2361abc4f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.808468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a339c0-eb09-4d9a-ad4c-ee2361abc4f9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.860191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:22.861032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:22.861311 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:22.861592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/89914458b95048e68ebfaa2a619ef7b0/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:22.871620 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6df3fcc135b54d5c8e2340a0237d6908, user_id=89914458b95048e68ebfaa2a619ef7b0, role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:22.873088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:22.911254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 65/134] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:22 2022] PUT /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/89914458b95048e68ebfaa2a619ef7b0/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:09:22.946179 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:22.960154 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 70/135] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:22.966145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:23.006850 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a458682-7b5c-4942-a9db-770e41cb77ad None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.007185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a458682-7b5c-4942-a9db-770e41cb77ad None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.007503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a458682-7b5c-4942-a9db-770e41cb77ad None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.009187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 71/136] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:23.037170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.037473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.037727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.063053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:23.064345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:23.171868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:23.189764 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3af029-8ffc-4940-9b85-441651abcbf3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:23.227439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 72/137] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 14:09:23.245191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:23.246069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.246354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.246628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.247869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:23.249315 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:23.251065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 66/138] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:22 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:23.260537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:23.262925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:23.377794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adda3-bc04-45ab-936a-2e498c9c7ec2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:23.425152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:23.425882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.426167 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.426441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.444725 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:23.454948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:23.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:23.456558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 67/139] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:23.462613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:23.495221 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:23.572132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f14d-020d-41c5-94f6-3c3461e14837 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:23.574730 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57660-8540-4812-8cca-da908b861e4e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:23.613771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:23.614449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.614742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.615179 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.615952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:23.616552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:23.618927 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:23.626382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:23.629440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 68/140] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:23.636474 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:23.716499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:23.717221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.717510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.717782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.718635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] RBAC: Adding query filter params (role.id=427e9747b6874712bda332570b8bbf4a, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=53d8fca727454e1483702a0ad917e9e4) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:23.718976 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:23.720450 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:23.736010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 73/141] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:23 2022] GET /identity/v3/role_assignments?user.id=53d8fca727454e1483702a0ad917e9e4&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=427e9747b6874712bda332570b8bbf4a => generated 259 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:23.767182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:23.775633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25a47-40ff-480c-b78a-a59388290803 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:23.813666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:23.814734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.815138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.815515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:23.816872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:23.818455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:23.820298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 69/142] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:23 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:23.826461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:23.942199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da957e0-0394-4240-9db1-013f9a26fa09 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:23.983759 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:23.984345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:23.984630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:23.984918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:24.042921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:24.060965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:24.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:24.170469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 74/143] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:09:24.175917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:24.282424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df535-44f6-4722-a43a-1924dbdac720 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:24.317678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93970d5-4b50-41db-9cc1-3395a0eb6e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:24.318551 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93970d5-4b50-41db-9cc1-3395a0eb6e26 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:24.318851 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93970d5-4b50-41db-9cc1-3395a0eb6e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:24.319130 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93970d5-4b50-41db-9cc1-3395a0eb6e26 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:24.320311 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93970d5-4b50-41db-9cc1-3395a0eb6e26 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:24.322266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93970d5-4b50-41db-9cc1-3395a0eb6e26 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:24.323982 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 70/144] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:24 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:24.330509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:24.418533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:24.435118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a9b41-3eb4-41c6-a024-6fd4bbc043b4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:24.469623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:24.470282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:24.470561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:24.470859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:24.471691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=89914458b95048e68ebfaa2a619ef7b0) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:24.471999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:24.473433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a8c92-2739-4392-a340-77361faa8e50 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:24.479364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 75/145] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:24 2022] GET /identity/v3/role_assignments?user.id=89914458b95048e68ebfaa2a619ef7b0&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:25.307440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082273-5220-43a8-8620-71486672f41f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.307948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082273-5220-43a8-8620-71486672f41f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.307948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082273-5220-43a8-8620-71486672f41f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.309341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 71/146] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:25.314859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a34773-6b50-421d-bf37-d76ce8801828 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.315281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a34773-6b50-421d-bf37-d76ce8801828 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.315459 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a34773-6b50-421d-bf37-d76ce8801828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.340073 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-54a34773-6b50-421d-bf37-d76ce8801828 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:25.341349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-54a34773-6b50-421d-bf37-d76ce8801828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:25.438628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 76/147] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:25.463052 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082273-5220-43a8-8620-71486672f41f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:25.483014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:25.528060 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c2c2-5b84-45a0-946b-2ae8ff296fa4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.528928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c2c2-5b84-45a0-946b-2ae8ff296fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.529400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c2c2-5b84-45a0-946b-2ae8ff296fa4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.531760 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 77/148] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:25.538913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.539413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.540096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.561364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:25.562934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:25.587932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082273-5220-43a8-8620-71486672f41f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:25.639148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 78/149] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:25.662157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:25.667605 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:25.668430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.668710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.668987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.670261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:25.671738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:25.673578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 72/150] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:25.683801 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:25.711230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:25.853018 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:25.853622 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e15fc5-935b-44b6-aee7-bac5c62e2d6d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:25.870448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8440-8039-4f79-8774-65a60d387050 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:25.900708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83b980-7916-4c30-a8c4-876a229a2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:25.901515 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83b980-7916-4c30-a8c4-876a229a2eeb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.901802 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83b980-7916-4c30-a8c4-876a229a2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.902090 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83b980-7916-4c30-a8c4-876a229a2eeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.907581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c97bf-6bec-4e05-b2d8-1e39026454ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:25.908249 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c97bf-6bec-4e05-b2d8-1e39026454ad None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.908530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c97bf-6bec-4e05-b2d8-1e39026454ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.908803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c97bf-6bec-4e05-b2d8-1e39026454ad None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.909522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c97bf-6bec-4e05-b2d8-1e39026454ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:25.910992 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c97bf-6bec-4e05-b2d8-1e39026454ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:25.913114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83b980-7916-4c30-a8c4-876a229a2eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9c83b980-7916-4c30-a8c4-876a229a2eeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:25.921192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:25.922063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:25.922853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 79/151] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:25.923681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2d874-2e76-4e32-8fcc-f9b5eeda5e8f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.925252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2d874-2e76-4e32-8fcc-f9b5eeda5e8f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.925647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2d874-2e76-4e32-8fcc-f9b5eeda5e8f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.927942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 80/152] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:25.932685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310b69e-80a3-4acf-b1f5-c0605d8d1dda None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.933061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310b69e-80a3-4acf-b1f5-c0605d8d1dda None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.933378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310b69e-80a3-4acf-b1f5-c0605d8d1dda None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.934692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 81/153] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:25.935574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310b69e-80a3-4acf-b1f5-c0605d8d1dda None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:25.947850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 73/154] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:25 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:25.949635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870bf4-40d4-480d-8bc6-de47622f93b1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:25.949741 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870bf4-40d4-480d-8bc6-de47622f93b1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:25.949996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870bf4-40d4-480d-8bc6-de47622f93b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:25.981640 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cf870bf4-40d4-480d-8bc6-de47622f93b1 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:25.982971 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cf870bf4-40d4-480d-8bc6-de47622f93b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:26.021081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.062668 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310b69e-80a3-4acf-b1f5-c0605d8d1dda None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.078203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 74/155] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:26.080017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293231bf-5130-4486-abff-289bf79aaecd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.080571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293231bf-5130-4486-abff-289bf79aaecd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.081037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293231bf-5130-4486-abff-289bf79aaecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.110438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-293231bf-5130-4486-abff-289bf79aaecd None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:26.112166 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-293231bf-5130-4486-abff-289bf79aaecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:26.123141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.123890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.124177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.124455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.125750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:26.126066 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:26.128158 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:26.141470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 82/156] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:26.141470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.196950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 75/157] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:26.197657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293231bf-5130-4486-abff-289bf79aaecd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.201697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.264849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a50f-f55f-4554-85a9-de1d3cc607a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.305305 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.313233 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.314048 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.314336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.314628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.327455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:26.328125 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293231bf-5130-4486-abff-289bf79aaecd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:26.335329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:26.336526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:26.337556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 83/158] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:26.338262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.374247 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.375245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.375625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.375999 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.377429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:26.379218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:26.381910 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 76/159] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:26.382800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.457157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd027bd0-e17d-41c6-8edb-98956f4d8d69 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.470331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.494595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.494987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.495271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.495550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.513814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:26.514751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975155-4341-4e52-9a27-2cb46451012c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:26.526429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:26.527408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:26.528189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:26.531034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 84/160] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:26.531983 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.568327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.569380 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.569877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.570449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.571464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:26.571979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:26.573760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:26.583944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 77/161] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:26.585261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.594557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.650481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3df97-9873-4035-8c2b-52e4a50a0752 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.687989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.688632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.688921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.689198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.708748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362da0-6450-47bb-83b0-ed0a49831423 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.742846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.750496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.751617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.752093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.752573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.753643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:26.754200 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:26.755857 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:26.763795 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:26.765290 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:26.766534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 78/162] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:26.771758 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.818761 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:26.873604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 85/163] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:26.874566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.890308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed228-d2a2-4899-ad56-7e1c80a51fb0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:26.932686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:26.933945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:26.934451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:26.934965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] PATH_INFO: `/v3/users/1630473ba96b4b308be7b0443882c517` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:26.936962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] RBAC: Authorizing `identity:get_user(user_id=1630473ba96b4b308be7b0443882c517)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:26.938747 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:26.940712 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 79/164] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/users/1630473ba96b4b308be7b0443882c517 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:26.942002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:26.986820 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828baf0-38b4-42c2-8a78-e66889417e36 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.020483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.027542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.028408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.028618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.028891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] PATH_INFO: `/v3/users/89914458b95048e68ebfaa2a619ef7b0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.030582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] RBAC: Authorizing `identity:get_user(user_id=89914458b95048e68ebfaa2a619ef7b0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.031647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.033313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 86/165] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/users/89914458b95048e68ebfaa2a619ef7b0 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:27.034173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.054034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.077431 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de71c-d9d5-4618-82f3-cc5a3aeab1cc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.116930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.118634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.119144 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.119625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] PATH_INFO: `/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.121354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] RBAC: Authorizing `identity:get_project(project_id=57f70a53ff3d4d6784a24c7c498f0ccc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.123069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.125479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 80/166] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:26 2022] GET /identity/v3/projects/57f70a53ff3d4d6784a24c7c498f0ccc => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:27.126603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.140979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35b33-ce6e-4a1c-aeda-f90017b7ddd9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.176949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.177618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.177902 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.178180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.241061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4b543-590f-4ff7-9136-301f11ab582d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.249368 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.250550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.270766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.275919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.284471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b391a8-ca28-459b-9841-0394c9265837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.285509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b391a8-ca28-459b-9841-0394c9265837 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.286053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b391a8-ca28-459b-9841-0394c9265837 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.286534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b391a8-ca28-459b-9841-0394c9265837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.361092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 87/167] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:27.361995 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.362973 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b391a8-ca28-459b-9841-0394c9265837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.365109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b391a8-ca28-459b-9841-0394c9265837 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.469677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830f831-e5e1-4e41-914a-326475344f42 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.481885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 81/168] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:27.486854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118ae1b-ad15-44a3-9dd9-8a5a42746d3f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.488199 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118ae1b-ad15-44a3-9dd9-8a5a42746d3f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.488592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118ae1b-ad15-44a3-9dd9-8a5a42746d3f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.490036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 82/169] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:27.490889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118ae1b-ad15-44a3-9dd9-8a5a42746d3f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.519234 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.523896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.579496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.580177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.580449 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.580750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.581585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=57f70a53ff3d4d6784a24c7c498f0ccc, user.id=89914458b95048e68ebfaa2a619ef7b0) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:27.581900 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.583384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.597555 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 88/170] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/role_assignments?user.id=89914458b95048e68ebfaa2a619ef7b0&scope.project.id=57f70a53ff3d4d6784a24c7c498f0ccc&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:27.598827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.610047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118ae1b-ad15-44a3-9dd9-8a5a42746d3f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.695296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa4b34-a30f-4ec5-a617-e2e36479ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.696996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4b34-a30f-4ec5-a617-e2e36479ebce None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.697105 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4b34-a30f-4ec5-a617-e2e36479ebce None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.697301 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4b34-a30f-4ec5-a617-e2e36479ebce None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.698552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa4b34-a30f-4ec5-a617-e2e36479ebce None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.700082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa4b34-a30f-4ec5-a617-e2e36479ebce None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.702013 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 83/171] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:27.708354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.708493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.708721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.714853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56dc8-c421-4eef-9717-4c85d1fe5554 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:27.736906 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:27.738102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:27.753186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:27.754437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:27.754963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:27.755447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:27.756937 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:27.759225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:27.761144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 89/172] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:27.762107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.840509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 84/173] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:27.841386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:27.858273 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.882750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:27.965797 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550cf8c-7ff7-461c-ab21-c0d1b3352b47 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.004058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6e1a4-7b2f-4c89-bbcd-45216b309859 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.030191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.030905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.031359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.031641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.033122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=1630473ba96b4b308be7b0443882c517) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:28.033446 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:28.035455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:28.050054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.052025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.052423 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.052844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.054300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] RBAC: Adding query filter params (role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=89914458b95048e68ebfaa2a619ef7b0) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:28.054763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:28.058010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 90/174] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/role_assignments?user.id=1630473ba96b4b308be7b0443882c517&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:28.058235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:28.058916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:28.065109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 85/175] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:27 2022] GET /identity/v3/role_assignments?user.id=89914458b95048e68ebfaa2a619ef7b0&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:28.247163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54c05-fd11-4d0a-8630-1876b41a00b0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.267357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:28.293235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.294046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.294332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.294610 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.308746 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:28.316848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:28.317791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:28.318574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 91/176] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:28.326693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:28.454691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:28.466172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf208-d550-4624-80b2-ae5f1b48bd87 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.502237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.502877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.503163 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.503438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.504218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:28.504522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:28.505933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:28.516124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 86/177] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:28.521979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:28.632572 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a315b3b-4fc7-4a76-9f7b-cbb24dd061e8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.669489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.670380 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.670671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.670973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] PATH_INFO: `/v3/users/53d8fca727454e1483702a0ad917e9e4` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.672236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] RBAC: Authorizing `identity:get_user(user_id=53d8fca727454e1483702a0ad917e9e4)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:28.673707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:28.675407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 92/178] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:28 2022] GET /identity/v3/users/53d8fca727454e1483702a0ad917e9e4 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:28.680979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:28.791682 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d32c6-5f15-4202-a24a-3c5ae9087646 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.830305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcf4d-871a-458b-83ae-9ee8ffef0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.831198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcf4d-871a-458b-83ae-9ee8ffef0f92 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.831480 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcf4d-871a-458b-83ae-9ee8ffef0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.831755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcf4d-871a-458b-83ae-9ee8ffef0f92 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.832959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcf4d-871a-458b-83ae-9ee8ffef0f92 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:28.834414 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcf4d-871a-458b-83ae-9ee8ffef0f92 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:28.836172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 87/179] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:28 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:28.843065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:28.892422 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:28.950979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235cfd2-faea-4f20-a0f8-6b996dbfe520 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:28.984272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860c82-8077-412b-a62a-4d7f00643722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:28.985172 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860c82-8077-412b-a62a-4d7f00643722 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:28.985458 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860c82-8077-412b-a62a-4d7f00643722 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:28.985735 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860c82-8077-412b-a62a-4d7f00643722 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/53d8fca727454e1483702a0ad917e9e4/roles/427e9747b6874712bda332570b8bbf4a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:28.987765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860c82-8077-412b-a62a-4d7f00643722 None admin] RBAC: Authorizing `identity:create_grant(project_id=6df3fcc135b54d5c8e2340a0237d6908, user_id=53d8fca727454e1483702a0ad917e9e4, role_id=427e9747b6874712bda332570b8bbf4a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:28.989224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860c82-8077-412b-a62a-4d7f00643722 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:29.004802 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 93/180] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:28 2022] PUT /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/users/53d8fca727454e1483702a0ad917e9e4/roles/427e9747b6874712bda332570b8bbf4a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:29.260099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459c25-b7bd-4d77-b582-5148e9a27cda None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.260495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459c25-b7bd-4d77-b582-5148e9a27cda None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.260670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459c25-b7bd-4d77-b582-5148e9a27cda None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.262257 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 88/181] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:29.269617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.269617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.269617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.286187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:29.287700 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:29.356992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 94/182] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:29.381452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459c25-b7bd-4d77-b582-5148e9a27cda None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:29.410260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:29.494628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459c25-b7bd-4d77-b582-5148e9a27cda None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:29.532749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a26bf0-d53b-4b20-a370-aba68b2207dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:29.533475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a26bf0-d53b-4b20-a370-aba68b2207dc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.533755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a26bf0-d53b-4b20-a370-aba68b2207dc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.534023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a26bf0-d53b-4b20-a370-aba68b2207dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.547451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a26bf0-d53b-4b20-a370-aba68b2207dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-56a26bf0-d53b-4b20-a370-aba68b2207dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:29.556201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:29.557160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:29.557919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 89/183] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:29.563750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:29.596458 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:29.674300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f37ed-f8c0-4463-996a-f4162410e0f9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:29.709882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:29.710885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.711383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.712362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.713265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:29.713718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:29.715294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:29.716443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916197cf-b86c-43e0-9ff4-9adfcffe3d2b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.716731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916197cf-b86c-43e0-9ff4-9adfcffe3d2b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.717005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916197cf-b86c-43e0-9ff4-9adfcffe3d2b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.718503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 90/184] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:29.723438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12860d-8612-4c75-8ec4-767571005291 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.723727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12860d-8612-4c75-8ec4-767571005291 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.724005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12860d-8612-4c75-8ec4-767571005291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.725352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 95/185] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:29.732125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:29.750377 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ba12860d-8612-4c75-8ec4-767571005291 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:29.752278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ba12860d-8612-4c75-8ec4-767571005291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:29.840539 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 91/186] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:29.841734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd319-ee30-42d7-93f4-3344e2a0c625 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.842033 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd319-ee30-42d7-93f4-3344e2a0c625 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.842306 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd319-ee30-42d7-93f4-3344e2a0c625 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.843735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 92/187] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:29.848948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.849236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.849517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.861332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:29.869712 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:29.870934 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:29.871989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a4d2-4cb6-419b-89d4-8ae13be84ea3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:29.879104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:29.913708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:29.914312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:29.914592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:29.914943 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] PATH_INFO: `/v3/users/48b2393b3c7147bfb3a86973ebafd986` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:29.929522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] RBAC: Authorizing `identity:get_user(user_id=48b2393b3c7147bfb3a86973ebafd986)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:29.932176 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:29.933919 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 96/188] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:29 2022] GET /identity/v3/users/48b2393b3c7147bfb3a86973ebafd986 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:29.939071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:29.943857 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 93/189] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:29.951829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.042626 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb1fb-6359-48df-b176-ab136c8bac19 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.056642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3a8c-1648-40c5-8d7e-4c8c216bea40 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.090473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.091480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.091770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.092052 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.098546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.099231 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.099512 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.099785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.103302 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:30.113222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:30.114166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 97/190] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:30.121148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.123144 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.141013 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.182390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.183877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.239478 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c45c-ab49-4e0b-b24b-c495ec397808 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.278610 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.279443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.279728 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.280442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.281666 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.283138 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.285049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 98/191] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:30.286046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.298402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 94/192] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:30.299528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.345956 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.377393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.404832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23824db-917a-4a21-beb9-4c53979400a6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.413541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6820e6c-e4b3-4954-bd96-ddbc82eb72fb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.440346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.441023 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.441314 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.441593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.442346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:30.442655 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.444107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.451202 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.452069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.452526 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.452647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 99/193] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:30.453074 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.453326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.454124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.455634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.477048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 95/194] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:30 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:30.477909 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.580245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e6be-66cc-45ff-8a1f-89406ee90e9b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.619931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.624135 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4f6df-2bdc-415a-9121-10e8d54d123e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.625750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de276ef-b614-4413-a192-5865a836473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.627539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de276ef-b614-4413-a192-5865a836473a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.628146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de276ef-b614-4413-a192-5865a836473a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.628274 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de276ef-b614-4413-a192-5865a836473a None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.629657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de276ef-b614-4413-a192-5865a836473a None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.631188 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de276ef-b614-4413-a192-5865a836473a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.633205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 100/195] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:30 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:30.643898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de276ef-b614-4413-a192-5865a836473a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.657924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.672043 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.674475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.675745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.676204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] PATH_INFO: `/v3/users/48b2393b3c7147bfb3a86973ebafd986` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.678756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=48b2393b3c7147bfb3a86973ebafd986)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.681370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.686942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 96/196] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:30 2022] GET /identity/v3/users/48b2393b3c7147bfb3a86973ebafd986 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:30.689553 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:30.789010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de276ef-b614-4413-a192-5865a836473a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.816365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557d30a-3b40-4fa2-aa42-a5ece989a0b4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:30.836087 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.837832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.838127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.838401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.839584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=48b2393b3c7147bfb3a86973ebafd986) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:30.839993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.841420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:30.850530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 101/197] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:30 2022] GET /identity/v3/role_assignments?user.id=48b2393b3c7147bfb3a86973ebafd986&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:30.863958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:30.864642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:30.864931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:30.865210 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:30.906566 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:30.951793 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:30.953597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:31.078194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 97/198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:31.086393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:31.181256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:31.226428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf37900-6ee5-4752-817f-a4683253c840 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:31.269057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d84a-405b-4f7c-bc64-310b3df0d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:31.270550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d84a-405b-4f7c-bc64-310b3df0d412 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:31.271057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d84a-405b-4f7c-bc64-310b3df0d412 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:31.271554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d84a-405b-4f7c-bc64-310b3df0d412 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:31.272946 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d84a-405b-4f7c-bc64-310b3df0d412 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:31.274671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d84a-405b-4f7c-bc64-310b3df0d412 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:31.276617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 102/199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:31 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:31.283888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:31.380727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:31.439713 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10222be-085f-449d-bb70-69b2a2e2ad43 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:31.441628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4588a9c-38a9-4d83-bcd9-2d808c05a534 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:31.442142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4588a9c-38a9-4d83-bcd9-2d808c05a534 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:31.442613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4588a9c-38a9-4d83-bcd9-2d808c05a534 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:31.444228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 103/200] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:31.450002 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:31.450529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:31.451173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:31.473799 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:31.476141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:31.509604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:31.511751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:31.512264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:31.512920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:31.514662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] RBAC: Adding query filter params (role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=48b2393b3c7147bfb3a86973ebafd986) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:31.515409 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:31.519669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:31.528236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 98/201] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:31 2022] GET /identity/v3/role_assignments?user.id=48b2393b3c7147bfb3a86973ebafd986&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:31.597260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 104/202] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:31.628721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:31.769466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789a76-a20f-4f09-9f0b-56263ee14e72 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:31.801161 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:31.808433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:31.809628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:31.810152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:31.810622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:31.821309 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:31.829416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:31.830286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:31.831104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:31.833813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 99/203] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:31.839409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:31.923427 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:31.961320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bba134-37a6-4db1-87db-99dd33d44da3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:32.016468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:32.017564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:32.018046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:32.018518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:32.020549 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:32.021163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:32.022760 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:32.038401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 105/204] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:32.044463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:32.160838 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494e7b5-bafd-4ad3-bc2b-583fe4dc9f0a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:32.196930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:32.198228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:32.198707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:32.199208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] PATH_INFO: `/v3/users/53d8fca727454e1483702a0ad917e9e4` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:32.200603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] RBAC: Authorizing `identity:get_user(user_id=53d8fca727454e1483702a0ad917e9e4)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:32.202259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:32.204153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 100/205] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:32 2022] GET /identity/v3/users/53d8fca727454e1483702a0ad917e9e4 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:32.213059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:32.356057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049c84-416c-4832-8b4c-0bd0bceef2fe None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:32.419819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:32.420480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:32.420764 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:32.421039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:32.425578 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:32.523808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:32.525420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:32.627062 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 106/206] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:32.632014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:32.724997 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:32.796889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ae23f-12d1-43f8-9375-8db3958b1809 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:32.843681 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143026a-baf3-4ef3-9f19-776d128208d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:32.844603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143026a-baf3-4ef3-9f19-776d128208d3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:32.844889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143026a-baf3-4ef3-9f19-776d128208d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:32.845166 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143026a-baf3-4ef3-9f19-776d128208d3 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:32.846357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143026a-baf3-4ef3-9f19-776d128208d3 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:32.847830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143026a-baf3-4ef3-9f19-776d128208d3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:32.849696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 101/207] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:32 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:32.856004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:32.931210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:33.026116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8eb75-717a-4670-bb14-f4bae4a812a8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:33.070647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289112-3089-4e66-b760-864259ea8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:33.072211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289112-3089-4e66-b760-864259ea8932 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.072711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289112-3089-4e66-b760-864259ea8932 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.073175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289112-3089-4e66-b760-864259ea8932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.074209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289112-3089-4e66-b760-864259ea8932 None admin] RBAC: Adding query filter params (role.id=427e9747b6874712bda332570b8bbf4a, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908, user.id=53d8fca727454e1483702a0ad917e9e4) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:33.074741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289112-3089-4e66-b760-864259ea8932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:33.076466 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289112-3089-4e66-b760-864259ea8932 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:33.089094 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 107/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:32 2022] GET /identity/v3/role_assignments?user.id=53d8fca727454e1483702a0ad917e9e4&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=427e9747b6874712bda332570b8bbf4a => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:33.456894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe642f-7af9-434f-ae1e-8503370cc3b6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.457211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe642f-7af9-434f-ae1e-8503370cc3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.457452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe642f-7af9-434f-ae1e-8503370cc3b6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.459024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 102/209] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:33.464783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa9786-2050-45da-8c01-29801fa8a97a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.465364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa9786-2050-45da-8c01-29801fa8a97a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.465845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa9786-2050-45da-8c01-29801fa8a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.487389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-07aa9786-2050-45da-8c01-29801fa8a97a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:33.488963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-07aa9786-2050-45da-8c01-29801fa8a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:33.578892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 108/210] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:33.591495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf033b-dfd7-4026-8cd5-73bd7d92f8e6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf033b-dfd7-4026-8cd5-73bd7d92f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.592619 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf033b-dfd7-4026-8cd5-73bd7d92f8e6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.594212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 103/211] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:33.599638 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.599932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.600212 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.609671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf033b-dfd7-4026-8cd5-73bd7d92f8e6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:33.625198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:33.625198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:33.654456 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:33.710294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 109/212] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:33.736984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:33.741479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf033b-dfd7-4026-8cd5-73bd7d92f8e6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:33.775804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:33.786241 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:33.787904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.788295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.788672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.811207 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:33.823578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:33.824535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:33.825328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 104/213] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:33.834578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:33.875507 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dcf21-a09a-45b2-82f7-919a0590a793 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:33.913065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:33.914167 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:33.915333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:33.916821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:33.918363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:33.920085 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:33.921959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 110/214] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:33.927397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:33.961544 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb7111-ca19-4984-ad8c-4bccbd3148d9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:33.968012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.000052 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.001131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.001504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.001741 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.002419 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:34.002726 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:34.004133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63427f0-375c-4974-8bde-8e5c5c7fc955 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:34.012567 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 105/215] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:34.013613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4fee-c72d-496a-a15a-4b1c67a6f685 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.013896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4fee-c72d-496a-a15a-4b1c67a6f685 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.014167 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4fee-c72d-496a-a15a-4b1c67a6f685 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.015533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 106/216] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:34.021335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f4fee-c72d-496a-a15a-4b1c67a6f685 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.054329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1e45-722a-4967-b3a4-0bbbfb3f449d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.078290 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.098894 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4f529-0689-4364-990b-8cf29854c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.099604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4f529-0689-4364-990b-8cf29854c67b None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.099889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4f529-0689-4364-990b-8cf29854c67b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.100159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4f529-0689-4364-990b-8cf29854c67b None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.100914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4f529-0689-4364-990b-8cf29854c67b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:34.102990 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4f529-0689-4364-990b-8cf29854c67b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:34.126741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 111/217] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:33 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:09:34.128263 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb7b5f-0c35-4b49-b2f9-057e6930dd09 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.128673 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb7b5f-0c35-4b49-b2f9-057e6930dd09 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.129068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb7b5f-0c35-4b49-b2f9-057e6930dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.150109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-24bb7b5f-0c35-4b49-b2f9-057e6930dd09 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:34.152389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-24bb7b5f-0c35-4b49-b2f9-057e6930dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:34.154963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f4fee-c72d-496a-a15a-4b1c67a6f685 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.205306 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.207809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.209949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.210393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] PATH_INFO: `/v3/users/ae8a79679d394f82af9f0d2b43557a17` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.236465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] RBAC: Authorizing `identity:get_user(user_id=ae8a79679d394f82af9f0d2b43557a17)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:34.238155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:34.244890 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 107/218] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/users/ae8a79679d394f82af9f0d2b43557a17 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:34.246592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.259049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 112/219] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:34.273674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a0e-29bc-4174-9ad7-cbe6ea220acf None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.275007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a0e-29bc-4174-9ad7-cbe6ea220acf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.275007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a0e-29bc-4174-9ad7-cbe6ea220acf None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.276433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 113/220] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:34.281926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.282218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.282500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.301470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:34.302744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:34.311896 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.382439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 114/221] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:34.382866 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1a5b-d51f-4120-9d8a-3e54dd11d56c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.387794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.390945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.437607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.438268 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.438555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.438886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.525359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9c5a7-8f10-4bb0-a250-e5f68ecaf719 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.534051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:34.534051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:34.572774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.574412 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.575135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.575553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.590505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:34.601601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:34.603324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:34.604304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:34.607098 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 115/222] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:34.608209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.611352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.658077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 108/223] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:09:34.659008 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.669968 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.755428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b739-f168-4d5e-9c0e-2669b50febf5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.771622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4a2b-5332-4f85-abbf-1049df110665 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.802531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.803758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.804187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.804906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.810077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:34.810888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:34.811265 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:34.811681 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:34.812547 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:34.812951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:34.814413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:34.819325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:34.828601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 109/224] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:34.828819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:34.829889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:34.830870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:34.832282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.833532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 116/225] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:34.834468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:34.911659 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.933649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:34.959269 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed7d0-38c6-4827-8804-4b63034bd613 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:34.976354 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640abb43-ff5f-41f6-91e5-aafc93fcaa0e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.008005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.009410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.009958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.010447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.011376 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.012126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.012444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.012815 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.013179 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] PATH_INFO: `/v3/users/48b2393b3c7147bfb3a86973ebafd986` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.014317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.014594 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] RBAC: Authorizing `identity:get_user(user_id=48b2393b3c7147bfb3a86973ebafd986)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.016281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.016540 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 110/226] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.017512 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.018297 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 117/227] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:34 2022] GET /identity/v3/users/48b2393b3c7147bfb3a86973ebafd986 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.025550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.130252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457387-bbab-441d-8e2e-a255799e521e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.158173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404fccb-0f10-4af8-ba17-96d1d5221e07 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.176447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.177818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.178297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.178762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.180932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:35.181443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.183609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.187559 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:35.189914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:35.197719 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.198695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 111/228] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.198836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.199290 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.199767 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.200140 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.200814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=ae8a79679d394f82af9f0d2b43557a17) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:35.201230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.202805 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.219256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 118/229] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:35 2022] GET /identity/v3/role_assignments?user.id=ae8a79679d394f82af9f0d2b43557a17&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.220148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.326187 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3301a8b-a167-412a-b2b6-a7bc3549eae6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.438187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bcaf9-0b47-4f4c-8102-e0d7613231b8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.456141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.457021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.457305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.457584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.459561 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.461233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.463341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 112/230] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:35 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.470005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.482372 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.483864 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.484170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.484452 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] PATH_INFO: `/v3/users/48b2393b3c7147bfb3a86973ebafd986` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.485680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=48b2393b3c7147bfb3a86973ebafd986)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.487727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.489905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 119/231] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:35 2022] GET /identity/v3/users/48b2393b3c7147bfb3a86973ebafd986 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.495955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.565987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:35.567614 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:35.610982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3a85-c9a6-4b09-a458-042b3bd56cc2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.628828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11074cb5-4e7a-45c9-9c15-e7c46994d1ff None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.648161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.649301 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.649748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.650154 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.651523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.653122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.659092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 120/232] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:35 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:35.662153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:35.707339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c0f17-33ff-484c-b25b-6aaf1d27d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.708515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0f17-33ff-484c-b25b-6aaf1d27d72c None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.708944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0f17-33ff-484c-b25b-6aaf1d27d72c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.709363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0f17-33ff-484c-b25b-6aaf1d27d72c None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272/users/48b2393b3c7147bfb3a86973ebafd986/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.712332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c0f17-33ff-484c-b25b-6aaf1d27d72c None admin] RBAC: Authorizing `identity:create_grant(project_id=8e40113cb3bf457086033de57a227272, user_id=48b2393b3c7147bfb3a86973ebafd986, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.714216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c0f17-33ff-484c-b25b-6aaf1d27d72c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.735583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 113/233] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:35 2022] PUT /identity/v3/projects/8e40113cb3bf457086033de57a227272/users/48b2393b3c7147bfb3a86973ebafd986/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:35.840882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e7e8f-f3d2-4b07-aa8a-6cd04ff3f15a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:35.872037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:35.885528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd7ac-a053-4964-9df8-f256d6e619c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:35.886460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd7ac-a053-4964-9df8-f256d6e619c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:35.886868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd7ac-a053-4964-9df8-f256d6e619c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:35.887156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd7ac-a053-4964-9df8-f256d6e619c4 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272/users/48b2393b3c7147bfb3a86973ebafd986/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:35.889433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd7ac-a053-4964-9df8-f256d6e619c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e40113cb3bf457086033de57a227272, user_id=48b2393b3c7147bfb3a86973ebafd986, role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:35.890956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd7ac-a053-4964-9df8-f256d6e619c4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:35.923431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 121/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:35 2022] PUT /identity/v3/projects/8e40113cb3bf457086033de57a227272/users/48b2393b3c7147bfb3a86973ebafd986/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:36.676171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51759f38-8a9f-44cb-8895-7820d8bf5ce2 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:36.677182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51759f38-8a9f-44cb-8895-7820d8bf5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:36.677696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51759f38-8a9f-44cb-8895-7820d8bf5ce2 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:36.679446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 114/235] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:36.692545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:36.692857 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:36.693121 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:36.719102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:36.720341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:36.799211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 122/236] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:36.833533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51759f38-8a9f-44cb-8895-7820d8bf5ce2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:36.972659 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51759f38-8a9f-44cb-8895-7820d8bf5ce2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:37.005987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:37.016644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08edee-7dc8-4ef7-877a-e49c668c8c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:37.017445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08edee-7dc8-4ef7-877a-e49c668c8c92 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.017726 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08edee-7dc8-4ef7-877a-e49c668c8c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.017998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08edee-7dc8-4ef7-877a-e49c668c8c92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.032697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08edee-7dc8-4ef7-877a-e49c668c8c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9e08edee-7dc8-4ef7-877a-e49c668c8c92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:37.040761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:37.041642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:37.042425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:37.048372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 115/237] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:37.053824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:37.072174 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46374f7-13e2-4d05-a635-4a672176f50a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.072468 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46374f7-13e2-4d05-a635-4a672176f50a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.072722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46374f7-13e2-4d05-a635-4a672176f50a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.074499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 116/238] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:37.080450 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.080735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.081011 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.111724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:37.113025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:37.241770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be83518-3c48-449e-834e-c5717fd7762a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:37.254809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 117/239] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:37.277294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:37.293950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:37.295080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.295561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.295992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.296932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:37.297409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:37.298974 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:37.304445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:37.310239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 123/240] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:37.315336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:37.513357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486e2a-3dd3-4da7-97e6-091bcc370051 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:37.517134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033134-0318-468f-bb26-8b4e2b8dece0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:37.539136 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:37.552577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:37.553470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.553750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.554034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] PATH_INFO: `/v3/users/8ebb9e0429e94233858eea32f75dc6f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.569516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebb9e0429e94233858eea32f75dc6f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:37.571945 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:37.573765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 124/241] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:37 2022] GET /identity/v3/users/8ebb9e0429e94233858eea32f75dc6f3 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:37.579224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:37.588033 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:37.588838 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.589117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.589389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.595529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:37.596955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:37.598900 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 118/242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:37.604691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:37.624706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:37.690579 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e471436-b55e-4aa6-ae88-3b8e7427a680 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:37.728469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:37.729134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.729417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.729687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.797312 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844a3de-cc6f-42df-99fb-527ec614da7a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:37.836669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f257eb-4123-4290-838e-289a821a7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:37.837382 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f257eb-4123-4290-838e-289a821a7b47 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.837662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f257eb-4123-4290-838e-289a821a7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.838213 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f257eb-4123-4290-838e-289a821a7b47 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.839017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f257eb-4123-4290-838e-289a821a7b47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:37.840699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f257eb-4123-4290-838e-289a821a7b47 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:37.848901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:37.850384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:37.880579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 119/243] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:37 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:09:37.907433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:37.936301 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8590b7-5272-4555-a86a-8193937a400c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.936874 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8590b7-5272-4555-a86a-8193937a400c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.937326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8590b7-5272-4555-a86a-8193937a400c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.939805 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 120/244] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:37.945886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:37.946607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:37.947147 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:37.984250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:37.985758 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:38.011310 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 125/245] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:09:38.017133 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.071850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.123945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 121/246] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:38.147865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.167733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3d24-fa6e-4389-9025-c10db46fa996 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.207828 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.210247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.210836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.211874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.213514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:38.215265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:38.217610 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 126/247] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:38.223283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.279963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49b98d-5f9d-4c5a-a260-d82e65f037fd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.325483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.326722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.327226 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.327777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.340444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:38.352515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:38.353389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:38.354277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:38.354896 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9ff8-559c-4d54-8b10-a3a2ec6081e5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.357011 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 122/248] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:38.363026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.397955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.399526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.399835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.400112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.400967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] RBAC: Adding query filter params (role.id=427e9747b6874712bda332570b8bbf4a, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=8ebb9e0429e94233858eea32f75dc6f3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:38.401279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:38.402856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ecd1-3a44-46ab-a0ec-87ab768bcb2d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:38.404287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.410603 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 127/249] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/role_assignments?user.id=8ebb9e0429e94233858eea32f75dc6f3&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=427e9747b6874712bda332570b8bbf4a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:38.447147 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add2db-d793-4af6-8be1-1dc7ccd5ec1b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.448398 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add2db-d793-4af6-8be1-1dc7ccd5ec1b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.449106 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add2db-d793-4af6-8be1-1dc7ccd5ec1b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.451708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 128/250] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:38.460639 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.461252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.461735 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.481974 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:38.483682 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:38.491553 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef9980-6854-46d3-b813-6790cd7c1399 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.534059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.535000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.535159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.535444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.536245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:38.536580 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:38.538014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:38.548853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 123/251] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:38.554465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.579056 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 129/252] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:38.603258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.607261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.676675 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb57a7-91bf-4498-9ca6-263af3f43534 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.689364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.719900 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.720785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.721070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.721401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] PATH_INFO: `/v3/users/ae8a79679d394f82af9f0d2b43557a17` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.722833 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] RBAC: Authorizing `identity:get_user(user_id=ae8a79679d394f82af9f0d2b43557a17)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:38.724337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:38.725377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62218741-0bfb-48aa-8318-b5c146802c20 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.726285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 124/253] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/users/ae8a79679d394f82af9f0d2b43557a17 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:38.732517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.762047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.762885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.763168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.763441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.784934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:38.797435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:38.798375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:38.799193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 130/254] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:38.810843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:38.901107 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2397ece-10ba-4862-a6ff-f2d6acc9bb2c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.906726 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.949789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4f1b-5e1e-440f-9d5e-119aafc5cfb2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:38.959557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:38.960438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:38.960721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:38.960996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:38.962895 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:38.964280 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:38.970600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 125/255] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:38.971493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:39.009871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:39.017386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:39.018276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.018707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.019187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.020361 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:39.020816 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:39.022353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ba02-1a81-47bf-8fc8-c781605cf56b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:39.032457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 131/256] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:39.034098 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6a7f-d714-4cff-b211-6cc112f6f4ff None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.034533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6a7f-d714-4cff-b211-6cc112f6f4ff None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.035108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6a7f-d714-4cff-b211-6cc112f6f4ff None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.036683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 132/257] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:39.042062 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6a7f-d714-4cff-b211-6cc112f6f4ff None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:39.141404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6291-620b-42d4-b82e-9c202ba9215f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:39.202184 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834a085-f25e-45d5-bbdd-b104798a9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:39.203104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a085-f25e-45d5-bbdd-b104798a9e5e None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.203381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a085-f25e-45d5-bbdd-b104798a9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.203653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a085-f25e-45d5-bbdd-b104798a9e5e None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272/users/ae8a79679d394f82af9f0d2b43557a17/roles/ad000b61baa1488c8cbae9dd0db42708` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.206443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834a085-f25e-45d5-bbdd-b104798a9e5e None admin] RBAC: Authorizing `identity:create_grant(project_id=8e40113cb3bf457086033de57a227272, user_id=ae8a79679d394f82af9f0d2b43557a17, role_id=ad000b61baa1488c8cbae9dd0db42708)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:39.207928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834a085-f25e-45d5-bbdd-b104798a9e5e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:39.222719 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6a7f-d714-4cff-b211-6cc112f6f4ff None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:39.236876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 126/258] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:38 2022] PUT /identity/v3/projects/8e40113cb3bf457086033de57a227272/users/ae8a79679d394f82af9f0d2b43557a17/roles/ad000b61baa1488c8cbae9dd0db42708 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:09:39.238299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.238588 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.238883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.261168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:39.262376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:39.288164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:39.320254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:39.321739 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.322028 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.322300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] PATH_INFO: `/v3/users/48b2393b3c7147bfb3a86973ebafd986` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.327660 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] RBAC: Authorizing `identity:get_user(user_id=48b2393b3c7147bfb3a86973ebafd986)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:39.329160 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:39.330908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 133/259] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:39 2022] GET /identity/v3/users/48b2393b3c7147bfb3a86973ebafd986 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:39.336087 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 127/260] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:39.337186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:39.377624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:39.427235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:39.563619 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5fc5c-3537-4606-a068-c655cd36c625 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:39.593771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9a9b3-f675-4b22-b659-eae761502a30 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:39.619938 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:39.620748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.621023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.621287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.643006 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:39.659483 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:39.660133 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.660457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.660732 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:39.661604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:39.662541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:39.663355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 128/261] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:39.670673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:39.767617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:39.779975 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:39.781449 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:39.846259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:39.897358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 134/262] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:39.904210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:39.920468 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a47bb-604d-4692-be7f-7c73c5440fec None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:39.973570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:39.974247 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:39.974530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:39.974818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:39.975592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:39.975897 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:39.977830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:39.986685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 129/263] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:39.992122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:40.051774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:40.068225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321aed-b4f4-413d-894a-8c831ae30e74 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:40.102265 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e54c4-2195-45a6-be2a-f83b5b11b481 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:40.128245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:40.129170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:40.129454 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:40.129724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:40.131669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:40.133257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:40.135436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 135/264] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:39 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:40.139023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:40.139905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:40.140191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:40.140466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] PATH_INFO: `/v3/users/48b2393b3c7147bfb3a86973ebafd986` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:40.141845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] RBAC: Authorizing `identity:get_user(user_id=48b2393b3c7147bfb3a86973ebafd986)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:40.142639 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:40.143383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:40.149806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 130/265] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:39 2022] GET /identity/v3/users/48b2393b3c7147bfb3a86973ebafd986 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:40.151045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:40.163679 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:40.256118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5fd21-93a2-4bfe-97a5-2c7f749c6006 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:40.292842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:40.293671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:40.294082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:40.294469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:40.305836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209846ab-31c1-477b-9a8a-1e121af964ea None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:40.364714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:40.366258 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:40.371054 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:40.371784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:40.372068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:40.372342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:40.373185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=48b2393b3c7147bfb3a86973ebafd986) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:40.373551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:40.375021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:40.387271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 136/266] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:40 2022] GET /identity/v3/role_assignments?user.id=48b2393b3c7147bfb3a86973ebafd986&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:40.387831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:40.482911 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 131/267] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:09:40.487925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:40.530068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:40.637967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1be4a-cec6-4b47-a9c7-3f14b93d2671 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:40.686530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f492f-c2bd-4354-814d-b6fc08d0f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:40.687437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f492f-c2bd-4354-814d-b6fc08d0f221 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:40.687717 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f492f-c2bd-4354-814d-b6fc08d0f221 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:40.687986 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f492f-c2bd-4354-814d-b6fc08d0f221 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:40.689261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f492f-c2bd-4354-814d-b6fc08d0f221 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:40.690798 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f492f-c2bd-4354-814d-b6fc08d0f221 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:40.692665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 137/268] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:40 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:40.699230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:40.844628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c639dd-1877-45c5-9480-4ea19fd51d88 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:40.855138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:40.889585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:40.890177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:40.890458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:40.890734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:40.891669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] RBAC: Adding query filter params (role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=48b2393b3c7147bfb3a86973ebafd986) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:40.891990 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:40.893437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462d3ac-d7e2-48b5-b101-cc337bf33caf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:40.906932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 132/269] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:40 2022] GET /identity/v3/role_assignments?user.id=48b2393b3c7147bfb3a86973ebafd986&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:41.439831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa563c8-55af-4904-9627-3077ddf2eeac None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.440338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa563c8-55af-4904-9627-3077ddf2eeac None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.440410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa563c8-55af-4904-9627-3077ddf2eeac None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.442012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 138/270] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:41.448287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9031062-e6d0-423e-b00b-5534ba1990e1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.448805 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9031062-e6d0-423e-b00b-5534ba1990e1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.448883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9031062-e6d0-423e-b00b-5534ba1990e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.466453 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a9031062-e6d0-423e-b00b-5534ba1990e1 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:41.468058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a9031062-e6d0-423e-b00b-5534ba1990e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:41.536099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 133/271] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:41.558723 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa563c8-55af-4904-9627-3077ddf2eeac None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:41.635058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5389ef-e260-48db-b52c-ef92f13063bd None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.635384 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5389ef-e260-48db-b52c-ef92f13063bd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.635629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5389ef-e260-48db-b52c-ef92f13063bd None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.638469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 134/272] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:41.642501 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.642809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.643100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.663752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:41.664900 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:41.665681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:41.676429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa563c8-55af-4904-9627-3077ddf2eeac None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:41.714773 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5b6bd-9667-4488-a9c1-c7d3febd04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:41.716189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5b6bd-9667-4488-a9c1-c7d3febd04fb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.716749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5b6bd-9667-4488-a9c1-c7d3febd04fb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.717246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5b6bd-9667-4488-a9c1-c7d3febd04fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.730800 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5b6bd-9667-4488-a9c1-c7d3febd04fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-42b5b6bd-9667-4488-a9c1-c7d3febd04fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:41.739548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:41.740506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:41.741284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:41.743146 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 135/273] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:41.744541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 139/274] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:41.750285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:41.754343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b555198-9a9f-4c8c-8910-469a97851faf None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.754885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b555198-9a9f-4c8c-8910-469a97851faf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.755449 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b555198-9a9f-4c8c-8910-469a97851faf None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.757196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 140/275] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:41.764269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.764634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.765009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.782436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:41.783648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:41.785748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:41.856587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 141/276] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:41.857874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:41.866987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bc21f-5924-4498-be5d-bfe3be14bac3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:41.906297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:41.906990 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:41.907274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:41.907542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:41.908284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:41.908583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:41.909938 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:41.923442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 136/277] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:41.923442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:41.947065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:41.970384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9313c2-ac2a-4cbe-a2ce-3ad3d29807ca None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.012193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.012988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.013276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.013552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.020515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:42.025211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:42.028342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cdd91-ab9f-40de-84d7-b3c41e4c4479 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:42.033304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:42.034159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:42.035707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:42.039131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 142/278] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:42.040543 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.066369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.067208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.067494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.067769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.068927 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.070418 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.072572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 137/279] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:42.077064 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.154274 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ca125-83b5-47b8-9288-a361c0f472f0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.189010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.189887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.190321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.190425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] PATH_INFO: `/v3/users/8ebb9e0429e94233858eea32f75dc6f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.191740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebb9e0429e94233858eea32f75dc6f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.193198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.198852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 143/280] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/users/8ebb9e0429e94233858eea32f75dc6f3 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:42.198852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.199053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d4fe9-6d78-482d-9aac-423024353953 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.211021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:42.235495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.236153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.236436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.236725 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.237540 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:42.237847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.239284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.248165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 138/281] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:42.248893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.278903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:42.317674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca661b-7fcc-49c1-be73-0be21e01a828 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.349943 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.350603 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.350916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.351190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.352433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.353861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.355948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a76a-4053-4fcd-834e-283467151985 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.374809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 144/282] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:09:42 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:42.379969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.393173 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d9c44-2e35-487f-b73c-60772c9015cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.394281 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9c44-2e35-487f-b73c-60772c9015cb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.394854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9c44-2e35-487f-b73c-60772c9015cb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.395130 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9c44-2e35-487f-b73c-60772c9015cb None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.396447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9c44-2e35-487f-b73c-60772c9015cb None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.397991 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9c44-2e35-487f-b73c-60772c9015cb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.405088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 139/283] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:42.405088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1336cd-7c03-417d-a49b-b873751f4a77 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.405088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1336cd-7c03-417d-a49b-b873751f4a77 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.405088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1336cd-7c03-417d-a49b-b873751f4a77 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.405088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 140/284] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:42.409668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1336cd-7c03-417d-a49b-b873751f4a77 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.468432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:42.511463 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9239-67f4-4d8c-b23e-fd5db88ab8aa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.522631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:42.534870 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1336cd-7c03-417d-a49b-b873751f4a77 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.549277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870824c2-eb00-4430-a419-3acb5efa70d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870824c2-eb00-4430-a419-3acb5efa70d7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.550475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870824c2-eb00-4430-a419-3acb5efa70d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.550694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870824c2-eb00-4430-a419-3acb5efa70d7 None admin] PATH_INFO: `/v3/users/5410f347dcd74f7b8d31787b248832f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.566395 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870824c2-eb00-4430-a419-3acb5efa70d7 None admin] RBAC: Authorizing `identity:get_user(user_id=5410f347dcd74f7b8d31787b248832f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.567905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870824c2-eb00-4430-a419-3acb5efa70d7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.569594 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 145/285] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/users/5410f347dcd74f7b8d31787b248832f3 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:42.571384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.571664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.571930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.574159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.575490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.575981 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.576256 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272/users/8ebb9e0429e94233858eea32f75dc6f3/roles/427e9747b6874712bda332570b8bbf4a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.578330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] RBAC: Authorizing `identity:create_grant(project_id=8e40113cb3bf457086033de57a227272, user_id=8ebb9e0429e94233858eea32f75dc6f3, role_id=427e9747b6874712bda332570b8bbf4a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.579828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.590046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:42.591286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:42.594062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 141/286] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:09:42 2022] PUT /identity/v3/projects/8e40113cb3bf457086033de57a227272/users/8ebb9e0429e94233858eea32f75dc6f3/roles/427e9747b6874712bda332570b8bbf4a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:42.594718 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.684644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 146/287] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:42.708674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.736400 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffcdd8-41de-433f-9ef1-f7c00ae3bbdc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.781121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.781121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.781121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.781121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.781566 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, user.id=5410f347dcd74f7b8d31787b248832f3, scope.system=all) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:42.781566 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:42.782985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:42.783840 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:42.791400 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 142/288] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/role_assignments?user.id=5410f347dcd74f7b8d31787b248832f3&scope.system=all&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:42.840601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348ab2-a256-4c94-890d-0d6c45eaa794 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:42.883569 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:42.884461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:42.884744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:42.885022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:42.898056 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:42.906587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:42.907588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:42.908357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:42.912819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 147/289] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:42.914819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:42.936021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:43.033082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06bb9e-3fa8-41f7-bec4-64f35aa1e39a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:43.074829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:43.074829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:43.074829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:43.074829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:43.075230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:43.075230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:43.075230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:43.083374 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 143/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:43.089743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:43.235189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1337ec-e54c-43c9-b5d8-cc532cfa920a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:43.254885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:43.282952 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:43.283890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:43.284115 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:43.284387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] PATH_INFO: `/v3/users/ae8a79679d394f82af9f0d2b43557a17` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:43.291549 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=ae8a79679d394f82af9f0d2b43557a17)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:43.293080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:43.294945 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 148/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:43 2022] GET /identity/v3/users/ae8a79679d394f82af9f0d2b43557a17 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:43.300598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:43.420357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:43.453610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2f47-6f0e-4016-87c3-1886ce87cbb8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:43.498273 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:43.498956 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:43.499236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:43.499508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:43.573916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:43.575309 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:43.676377 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:43.705455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 144/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:43.711829 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:43.839777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab6cc-1ab8-4b33-b262-be0fe95c4dd1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:43.872899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1924b72-d9e5-4b56-9a2b-eccc13e72505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:43.873764 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924b72-d9e5-4b56-9a2b-eccc13e72505 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:43.874045 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924b72-d9e5-4b56-9a2b-eccc13e72505 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:43.874317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924b72-d9e5-4b56-9a2b-eccc13e72505 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:43.875518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1924b72-d9e5-4b56-9a2b-eccc13e72505 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:43.876959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1924b72-d9e5-4b56-9a2b-eccc13e72505 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:43.878966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 149/293] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:43 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:43.885096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:44.035599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9bf93-fc7e-4bbe-9a7e-623440123713 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:44.084529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:44.085192 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:44.085477 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:44.085755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:44.086620 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=ae8a79679d394f82af9f0d2b43557a17) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:44.086965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:44.088407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175aa82-dcf5-4872-bcde-830ad1729f3f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:44.099356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 145/294] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:43 2022] GET /identity/v3/role_assignments?user.id=ae8a79679d394f82af9f0d2b43557a17&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:45.164096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700b8a-2933-4ea2-b67f-bd8baa26a223 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.164729 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700b8a-2933-4ea2-b67f-bd8baa26a223 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.164729 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700b8a-2933-4ea2-b67f-bd8baa26a223 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.166275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 150/295] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:45.172401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c609d-0861-4571-9d8a-5a4b0de15b69 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.173373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c609d-0861-4571-9d8a-5a4b0de15b69 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.173872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c609d-0861-4571-9d8a-5a4b0de15b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.192088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f49c609d-0861-4571-9d8a-5a4b0de15b69 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:45.193630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f49c609d-0861-4571-9d8a-5a4b0de15b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:45.232844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:45.272283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 146/296] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:45.292706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59700b8a-2933-4ea2-b67f-bd8baa26a223 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.328831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98426174-92ae-4112-97c2-9b40c816a195 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.329445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98426174-92ae-4112-97c2-9b40c816a195 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.330000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98426174-92ae-4112-97c2-9b40c816a195 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.331858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 147/297] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:45.337571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c317-de53-4f1b-9240-73d09f525813 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.338132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c317-de53-4f1b-9240-73d09f525813 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.338610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c317-de53-4f1b-9240-73d09f525813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.350623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:45.356068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f183c317-de53-4f1b-9240-73d09f525813 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:45.357476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f183c317-de53-4f1b-9240-73d09f525813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:45.421096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59700b8a-2933-4ea2-b67f-bd8baa26a223 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.432512 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 148/298] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:45.433889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21aa20-4dd8-4397-b007-e6b5ee005d0e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.434176 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21aa20-4dd8-4397-b007-e6b5ee005d0e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.434447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21aa20-4dd8-4397-b007-e6b5ee005d0e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.435866 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 149/299] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:45.439046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f568-5ee5-4423-8a0b-e1571976348a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.439335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f568-5ee5-4423-8a0b-e1571976348a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.439688 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f568-5ee5-4423-8a0b-e1571976348a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.440955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 150/300] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:45.442049 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.442519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.442962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.460738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:45.461906 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:45.462289 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9e5e8-5436-490d-aae8-ca301e477c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:45.463128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e5e8-5436-490d-aae8-ca301e477c37 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.463411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e5e8-5436-490d-aae8-ca301e477c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.463691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e5e8-5436-490d-aae8-ca301e477c37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.473623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9e5e8-5436-490d-aae8-ca301e477c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-78c9e5e8-5436-490d-aae8-ca301e477c37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:45.481486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:45.482447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:45.483260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 151/301] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:45.485540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.485969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.486253 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.502382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:45.503618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:45.527722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 151/302] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:45.542941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.560159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:45.572144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 152/303] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:45.572983 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.612918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:45.634222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05be9-7419-46f5-a4c5-1c2fdfc2328f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.667969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:45.668749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.669025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.669293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.670131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e8d2-17fa-40c5-ad11-3aa5e29d7c3a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.680792 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:45.688556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:45.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:45.690185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 152/304] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:45.690864 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.705636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:45.706325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.706607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.706911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.707689 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:45.708003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:45.709437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:45.722396 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 153/305] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:45.724053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.786569 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:45.796301 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d533e9-0efe-462f-a052-b3970e256b7c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.828809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:45.829587 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.829866 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.830138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.831295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7705dcd-1a84-4cba-ba3e-8672411903e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.832804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:45.840759 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:45.848430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:45.849352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:45.850113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 153/306] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:45.850779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.868551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:45.869337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.869614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.869884 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.871119 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:45.872580 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:45.874183 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 154/307] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:45.874962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:45.955650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b3cbe-97cf-494b-9bdd-803c08c8c855 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.972968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9888df-f831-444b-9c5a-fb9b9122ab04 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:45.988154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:45.988808 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:45.989086 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:45.989360 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:45.990102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:45.990405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:45.991792 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.000453 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 154/308] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.001862 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.010421 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.012870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.014984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.015306 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] PATH_INFO: `/v3/users/8ebb9e0429e94233858eea32f75dc6f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.016583 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] RBAC: Authorizing `identity:get_user(user_id=8ebb9e0429e94233858eea32f75dc6f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.018137 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.020265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 155/309] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:45 2022] GET /identity/v3/users/8ebb9e0429e94233858eea32f75dc6f3 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.021528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.028535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.063700 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.105786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7c30-2f5a-4760-93e1-ab2279c1d6b7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.125308 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea111b1-ae6f-40a7-b58f-c83908c6320f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.140606 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.141274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.141576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.141855 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.142598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:46.142930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.144564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.157562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 155/310] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.157562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.159824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.160490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.160770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.161043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] PATH_INFO: `/v3/groups` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.161726 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.163200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.177047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 156/311] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:09:46 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:46.178652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.239116 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.267627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3966fb-831c-4801-af20-9ecda8ffda77 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.304989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.308961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8be588-ab66-45c4-b03c-552a94c91fac None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.309778 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.310940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.311452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.311935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] PATH_INFO: `/v3/users/761e9bc5ec014fe985a6a2db071433c0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.328991 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] RBAC: Authorizing `identity:get_user(user_id=761e9bc5ec014fe985a6a2db071433c0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.330469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.337009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 156/312] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/users/761e9bc5ec014fe985a6a2db071433c0 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.337009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.354456 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.355167 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.355442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.355724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.438302 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.440562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.443619 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4e7c3-b6b9-4e1b-b04d-eb5a45dd7140 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.480165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.481032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.481311 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.481580 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] PATH_INFO: `/v3/users/5410f347dcd74f7b8d31787b248832f3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.483191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] RBAC: Authorizing `identity:get_user(user_id=5410f347dcd74f7b8d31787b248832f3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.484993 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.487123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 157/313] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/users/5410f347dcd74f7b8d31787b248832f3 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.487770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.490486 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.549105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.555011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 157/314] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:46.556174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.592357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb57b6-bac0-499c-81ef-4654930e05a3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.630774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.631443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.631719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.631989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.632841 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] RBAC: Adding query filter params (role.id=427e9747b6874712bda332570b8bbf4a, user.id=761e9bc5ec014fe985a6a2db071433c0, scope.system=all) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:46.633150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.634567 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.639946 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 158/315] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/role_assignments?user.id=761e9bc5ec014fe985a6a2db071433c0&scope.system=all&role.id=427e9747b6874712bda332570b8bbf4a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.640711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.677756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409459f-7379-4526-8b48-18f50eac9c45 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.718360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.719278 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.719609 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.719885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] PATH_INFO: `/v3/system/users/5410f347dcd74f7b8d31787b248832f3/roles/ad000b61baa1488c8cbae9dd0db42708` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.721688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5410f347dcd74f7b8d31787b248832f3, role_id=ad000b61baa1488c8cbae9dd0db42708)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.723591 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.739364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.750928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 158/316] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:09:46 2022] PUT /identity/v3/system/users/5410f347dcd74f7b8d31787b248832f3/roles/ad000b61baa1488c8cbae9dd0db42708 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:46.800480 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9dd4b-f0e8-4f5f-95ed-81433117e45a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:46.842701 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782380d7-d22c-46bf-976e-5c70d5deb38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:46.843660 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782380d7-d22c-46bf-976e-5c70d5deb38c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:46.843939 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782380d7-d22c-46bf-976e-5c70d5deb38c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:46.844250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782380d7-d22c-46bf-976e-5c70d5deb38c None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:46.845557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782380d7-d22c-46bf-976e-5c70d5deb38c None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:46.847190 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782380d7-d22c-46bf-976e-5c70d5deb38c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:46.849340 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 159/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:46.855695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:46.929355 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:46.974706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24904ed4-412b-43ab-977e-44f7ea51e2d0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:47.011346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:47.011922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:47.012198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:47.012466 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:47.013300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] RBAC: Adding query filter params (role.id=427e9747b6874712bda332570b8bbf4a, scope.project.id=8e40113cb3bf457086033de57a227272, user.id=8ebb9e0429e94233858eea32f75dc6f3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:47.013606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:47.015080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd35b0-4123-4c0d-9406-3d6d99c0f4f6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:47.022067 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 159/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:09:46 2022] GET /identity/v3/role_assignments?user.id=8ebb9e0429e94233858eea32f75dc6f3&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=427e9747b6874712bda332570b8bbf4a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:48.456016 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12ea7-25c4-4b10-be94-95f4f2fd26bd None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:48.456537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12ea7-25c4-4b10-be94-95f4f2fd26bd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:48.456537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12ea7-25c4-4b10-be94-95f4f2fd26bd None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:48.458051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 160/319] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:48.463642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:48.464057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:48.464350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:48.482043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:48.483277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:48.553170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 160/320] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:48.576935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12ea7-25c4-4b10-be94-95f4f2fd26bd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:48.690305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12ea7-25c4-4b10-be94-95f4f2fd26bd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:48.728905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e1df-ea86-4f67-97e0-7fbe8cbf898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:48.729791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e1df-ea86-4f67-97e0-7fbe8cbf898f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:48.730075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e1df-ea86-4f67-97e0-7fbe8cbf898f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:48.730345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e1df-ea86-4f67-97e0-7fbe8cbf898f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:48.731685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e1df-ea86-4f67-97e0-7fbe8cbf898f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:48.733167 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e1df-ea86-4f67-97e0-7fbe8cbf898f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:48.735159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 161/321] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:09:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:48.740776 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:48.802950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:48.854435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36786b6-4495-4a0e-b310-d678492894b0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:48.891999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b44d3-7f2a-4f82-b37d-0594c8ffdad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:48.892674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b44d3-7f2a-4f82-b37d-0594c8ffdad2 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:48.893006 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b44d3-7f2a-4f82-b37d-0594c8ffdad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:48.893288 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b44d3-7f2a-4f82-b37d-0594c8ffdad2 None admin] PATH_INFO: `/v3/groups` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:48.893993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b44d3-7f2a-4f82-b37d-0594c8ffdad2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:48.895735 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b44d3-7f2a-4f82-b37d-0594c8ffdad2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:48.910619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 161/322] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:09:48 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:09:48.915337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbfe2-211b-4442-89a9-4a14575a6fc4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:48.915888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbfe2-211b-4442-89a9-4a14575a6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:48.916408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbfe2-211b-4442-89a9-4a14575a6fc4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:48.918027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 162/323] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:48.924164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585c935-32a5-45b1-bd1c-1a1ad83dd398 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:48.924460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585c935-32a5-45b1-bd1c-1a1ad83dd398 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:48.924731 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585c935-32a5-45b1-bd1c-1a1ad83dd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:48.943082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3585c935-32a5-45b1-bd1c-1a1ad83dd398 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:48.944229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3585c935-32a5-45b1-bd1c-1a1ad83dd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:49.023428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 162/324] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:49.027684 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003296-5ed0-4737-b8fa-f07c40fdcf43 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.028084 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003296-5ed0-4737-b8fa-f07c40fdcf43 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.028431 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003296-5ed0-4737-b8fa-f07c40fdcf43 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.029947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 163/325] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:49.037898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.038196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.038455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.047820 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003296-5ed0-4737-b8fa-f07c40fdcf43 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.051295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:49.058875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:49.063007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:49.114947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:49.145905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 163/326] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:49.169614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.176444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003296-5ed0-4737-b8fa-f07c40fdcf43 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.221211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.222038 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.222325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.222605 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.239814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:49.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:49.249276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:49.250485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 164/327] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:49.255317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.297968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52b61-c611-4dcd-b4c0-72dfe7b03736 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.342548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:49.346569 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.347564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.347687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.347940 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.361445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:49.372621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:49.373792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:49.374887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 164/328] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:49.380022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.410411 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b8d0-0645-4b9a-870e-50c47a58402d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.429230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:49.461876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.462543 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.462843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.463373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.464158 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:49.465021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:49.466678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:49.482416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 165/329] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:49.491016 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.512654 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb42f-9cc3-4143-acd4-66ceec04670e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.550758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.551838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.552343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.552832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.553824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:49.554906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:49.556515 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:49.566655 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 165/330] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:49.575247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.616237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3be56d-d61a-4560-8973-43afc0cb641a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.651075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:49.671418 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.672373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.672656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.672928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] PATH_INFO: `/v3/users/761e9bc5ec014fe985a6a2db071433c0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.675318 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] RBAC: Authorizing `identity:get_user(user_id=761e9bc5ec014fe985a6a2db071433c0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:49.676743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:49.678384 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 166/331] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/users/761e9bc5ec014fe985a6a2db071433c0 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:49.687791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.715188 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:49.720979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429c60-1753-481e-ad0b-8647126eb433 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.768704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.769782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.770064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.770715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] PATH_INFO: `/v3/users/5410f347dcd74f7b8d31787b248832f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.772292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] RBAC: Authorizing `identity:get_user(user_id=5410f347dcd74f7b8d31787b248832f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:49.774016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:49.778315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 166/332] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/users/5410f347dcd74f7b8d31787b248832f3 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:49.783609 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:49.822941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3b6d3-2302-459e-8a6d-a4909e6ffefd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.889683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03fae-5db0-4c5b-a1ef-0e51bc907643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.890883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03fae-5db0-4c5b-a1ef-0e51bc907643 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.891344 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03fae-5db0-4c5b-a1ef-0e51bc907643 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.891944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03fae-5db0-4c5b-a1ef-0e51bc907643 None admin] PATH_INFO: `/v3/system/users/761e9bc5ec014fe985a6a2db071433c0/roles/427e9747b6874712bda332570b8bbf4a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.895548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03fae-5db0-4c5b-a1ef-0e51bc907643 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=761e9bc5ec014fe985a6a2db071433c0, role_id=427e9747b6874712bda332570b8bbf4a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:49.898287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03fae-5db0-4c5b-a1ef-0e51bc907643 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:49.932692 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 167/333] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:09:49 2022] PUT /identity/v3/system/users/761e9bc5ec014fe985a6a2db071433c0/roles/427e9747b6874712bda332570b8bbf4a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:49.945236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0e38-dd34-43be-b450-50bcc9b3a020 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:49.985715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:49.986630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:49.987104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:49.987552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:49.988548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] RBAC: Adding query filter params (role.id=ad000b61baa1488c8cbae9dd0db42708, user.id=5410f347dcd74f7b8d31787b248832f3, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:49.989011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:49.990742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9adcbe-ccc6-4046-b76b-7c4df9a5032c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:50.004968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 167/334] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:09:49 2022] GET /identity/v3/role_assignments?user.id=5410f347dcd74f7b8d31787b248832f3&scope.system=all&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:51.903487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b32ce-ed8f-47de-a5c9-10a083668f8b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:51.904500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b32ce-ed8f-47de-a5c9-10a083668f8b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:51.905005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b32ce-ed8f-47de-a5c9-10a083668f8b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:51.906657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 168/335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:51.917325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:51.918285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:51.918773 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:51.942868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:51.944831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:51.965000 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:52.037443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 168/336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:52.074751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b32ce-ed8f-47de-a5c9-10a083668f8b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:52.145639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:52.200530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b32ce-ed8f-47de-a5c9-10a083668f8b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:52.238846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4727db2-80c4-4cc7-82ac-57ed39e3fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:52.239655 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4727db2-80c4-4cc7-82ac-57ed39e3fac8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.239939 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4727db2-80c4-4cc7-82ac-57ed39e3fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.240213 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4727db2-80c4-4cc7-82ac-57ed39e3fac8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.257899 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4727db2-80c4-4cc7-82ac-57ed39e3fac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e4727db2-80c4-4cc7-82ac-57ed39e3fac8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:52.266194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:52.267111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:52.268310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 169/337] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:52.274087 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:52.328885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ae6e-03e4-4c99-83cd-3d0d8bd9c832 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.329211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ae6e-03e4-4c99-83cd-3d0d8bd9c832 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.329441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ae6e-03e4-4c99-83cd-3d0d8bd9c832 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.330824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 170/338] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:52.337194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.337503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.337744 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.367650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:52.368884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:52.442853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93b9e8-e300-41e9-b6e9-c391128a3ad5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:52.491516 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 171/339] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:52.496412 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:52.497105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.497392 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.497671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.498443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:52.498754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:52.500166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:52.511590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 169/340] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:52.517115 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:52.541541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:52.574566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:52.609230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:52.698714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55cd5-c120-4ce1-8023-560e48209bc8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:52.746196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441575f4-4e6e-4eb7-ba9d-08512fd9bcfe None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:52.790818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:52.792217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.792992 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.793909 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.794658 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ac8a2-b008-4986-a532-cb7ee8d7fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:52.795629 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac8a2-b008-4986-a532-cb7ee8d7fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.796654 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac8a2-b008-4986-a532-cb7ee8d7fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.799174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac8a2-b008-4986-a532-cb7ee8d7fc86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.824125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ac8a2-b008-4986-a532-cb7ee8d7fc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5b6ac8a2-b008-4986-a532-cb7ee8d7fc86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:52.833688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:52.837701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:52.838833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:52.841606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 170/341] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:52.843665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccaa0-c10e-4f8f-8175-30959753a9d6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.844100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccaa0-c10e-4f8f-8175-30959753a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.844517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccaa0-c10e-4f8f-8175-30959753a9d6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.846227 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 171/342] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:52.851908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:52.852445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:52.852944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:52.879145 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:52.885866 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:52.949448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:52.951732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:53.041677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 172/343] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:53.043303 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.053608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.094754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.173568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4a12-c2d0-4ed5-b17d-5bf9fd505d0a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:53.216537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:53.217628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.218119 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.218615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:53.220656 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:53.222314 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:53.234295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 173/344] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:53.235514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.257540 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 172/345] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:53.258416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.332601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.378631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294773fe-78eb-45a7-834a-f7091e957c39 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:53.378871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67be1-ed2e-4d99-b744-2e7d13e7b81d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:53.422595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db97c-c6cc-4d34-bfd3-3c3fe4b06d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:53.423369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db97c-c6cc-4d34-bfd3-3c3fe4b06d1e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.423605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91478-6b80-494d-ab6d-2d701a89f670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:53.423788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db97c-c6cc-4d34-bfd3-3c3fe4b06d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.424135 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db97c-c6cc-4d34-bfd3-3c3fe4b06d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.424585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91478-6b80-494d-ab6d-2d701a89f670 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.424951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91478-6b80-494d-ab6d-2d701a89f670 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.425286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91478-6b80-494d-ab6d-2d701a89f670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.439413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91478-6b80-494d-ab6d-2d701a89f670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:53.442942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-14f91478-6b80-494d-ab6d-2d701a89f670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:53.449929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:53.450911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:53.451730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 174/346] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:53.452980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d69fc8-8a58-47a6-b509-7d3feb555c11 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.455007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d69fc8-8a58-47a6-b509-7d3feb555c11 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.455007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d69fc8-8a58-47a6-b509-7d3feb555c11 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.456077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 175/347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:53.457158 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d69fc8-8a58-47a6-b509-7d3feb555c11 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.515736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db97c-c6cc-4d34-bfd3-3c3fe4b06d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:53.518594 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db97c-c6cc-4d34-bfd3-3c3fe4b06d1e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:53.599584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d69fc8-8a58-47a6-b509-7d3feb555c11 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:53.636442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.647676 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:53.649213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.649843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.650345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.652060 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:53.653816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 173/348] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:53.653968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:53.655470 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c0ea-43cb-4fc2-a928-109a81120fd5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.655925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c0ea-43cb-4fc2-a928-109a81120fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.656038 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 176/349] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:53.656441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c0ea-43cb-4fc2-a928-109a81120fd5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.656955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.658035 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 174/350] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:53.659266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.659692 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.660109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.683146 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:53.684583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:53.732880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.762147 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 175/351] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:53.763082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.787254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0a9-75ee-44a5-976e-e51a45d66eab None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:53.824953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:53.825635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.825918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.826971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:53.827276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:53.828649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:53.837979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 177/352] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:53.838824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:53.888022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2fe2-5500-434f-9147-99bf92e9427c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:53.927508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:53.938591 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5f4cb-4349-4df9-a110-bbd657d9924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:53.939501 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5f4cb-4349-4df9-a110-bbd657d9924b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.941717 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5f4cb-4349-4df9-a110-bbd657d9924b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.941717 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5f4cb-4349-4df9-a110-bbd657d9924b None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.943786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5f4cb-4349-4df9-a110-bbd657d9924b None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:53.945349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5f4cb-4349-4df9-a110-bbd657d9924b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:53.947484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 176/353] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:53.949012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:53.949012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:53.949305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:53.971798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:53.974152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:53.996672 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b1b45-402d-42dd-91be-07c0190e8c61 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.029898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.054378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.055444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.056066 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.056463 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.063767 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 177/354] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:54.064609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.064713 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:54.066227 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:54.069302 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 178/355] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:53 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:54.070443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.190435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569513b-a579-48d0-9733-c384d743efa9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.192321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30e05-d710-4f99-852b-c267b8ee1b26 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.217620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.231534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.232191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.232475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.232745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.240995 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.241826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.243159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.243436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.254858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:54.263576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:54.264455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:54.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 178/356] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:54.265891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.307806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.311428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:54.312891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:54.383742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ac19-45ea-4986-bc5f-00bbaa066e58 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.420932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46f851-bacc-48d0-8c7d-834fcfe7e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.421939 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46f851-bacc-48d0-8c7d-834fcfe7e5af None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.422219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46f851-bacc-48d0-8c7d-834fcfe7e5af None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.422487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46f851-bacc-48d0-8c7d-834fcfe7e5af None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.424316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46f851-bacc-48d0-8c7d-834fcfe7e5af None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:54.425783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46f851-bacc-48d0-8c7d-834fcfe7e5af None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:54.429555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 179/357] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:54.429555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e56e-e21b-42de-9a45-5ebd12ae50e3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.429555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e56e-e21b-42de-9a45-5ebd12ae50e3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.429831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e56e-e21b-42de-9a45-5ebd12ae50e3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.431073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 180/358] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:54.435603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e56e-e21b-42de-9a45-5ebd12ae50e3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.448943 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 179/359] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:54.448943 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.476380 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.567781 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e56e-e21b-42de-9a45-5ebd12ae50e3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.569298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.571096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71466-53e4-447b-88c7-1ba6799cee6e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.612273 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38dc55-835e-4b53-bb6c-00c496b58758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.613126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38dc55-835e-4b53-bb6c-00c496b58758 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.613409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38dc55-835e-4b53-bb6c-00c496b58758 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.613678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38dc55-835e-4b53-bb6c-00c496b58758 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.615137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.615280 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.615462 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.615738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.617118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:54.617431 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:54.619826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:54.626034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38dc55-835e-4b53-bb6c-00c496b58758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:54.626176 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 181/360] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:54.627346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2a38dc55-835e-4b53-bb6c-00c496b58758 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:54.646419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:54.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:54.648693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 180/361] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:54.649652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.649652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.649652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.668129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:54.669474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:54.767334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf866-895f-496d-8fc5-dcb7ec64b133 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.778833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 181/362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:54.778833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.797703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.810954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e5922-37de-43fc-9009-510e07e805de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.811638 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e5922-37de-43fc-9009-510e07e805de None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.811914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e5922-37de-43fc-9009-510e07e805de None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.812184 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e5922-37de-43fc-9009-510e07e805de None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.812950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e5922-37de-43fc-9009-510e07e805de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:54.813250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e5922-37de-43fc-9009-510e07e805de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:54.814644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e5922-37de-43fc-9009-510e07e805de None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:54.827824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 182/363] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:54.828511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e5922-37de-43fc-9009-510e07e805de None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.864590 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:54.918918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6009e-f347-4f06-8bb2-66632bc4f741 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.955686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e5922-37de-43fc-9009-510e07e805de None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:54.967529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:54.968201 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:54.968483 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:54.968757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:54.970042 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:54.970633 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:54.972340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:54.979922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 182/364] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:54.980583 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:54.998991 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.000555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.001068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.001574 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.003273 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.005056 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.007782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 183/365] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.008974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.103269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.127932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc15a-5a30-4081-ab55-6821feda0a43 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.145729 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.157251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ece3d-e4c4-460f-95ea-e1066fcc4219 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.183628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.184331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.184621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.184905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.185753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:55.186075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.189117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.202552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 183/366] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.203702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.205744 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.207011 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.207531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.208854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.223526 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:55.232408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:55.233327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:09:55.234093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:55.236611 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 184/367] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:55.237596 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.322833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47193-29ee-4461-aa5b-e0fba3622d9b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.360465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.362120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.362666 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.363457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.367422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585dd04-77a5-4acd-a237-cc794dfc4e55 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.387181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.429772 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.430722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.431088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.431423 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.433142 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.435181 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.437866 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 185/368] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.438647 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.473697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.480483 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.483030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.566552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6653e1-bcda-488b-85b6-6ddc57ea7a5b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.603754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 184/369] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:55.604615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.609094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.610203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.610736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.611328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] PATH_INFO: `/v3/users/761e9bc5ec014fe985a6a2db071433c0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.613321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] RBAC: Authorizing `identity:get_user(user_id=761e9bc5ec014fe985a6a2db071433c0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.615526 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.622880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 186/370] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/users/761e9bc5ec014fe985a6a2db071433c0 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.622880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.659341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.732395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.743560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf117-31dc-4bbc-af0e-b9681f94ea28 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.744504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98752cb-df31-4bed-aec3-9668f8545f35 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.785509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.786505 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.786983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.787425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.787904 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.789154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=8e40113cb3bf457086033de57a227272) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:55.789280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.789505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.789847 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.790126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.790749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:55.791146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.792081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.792664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.798143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 187/371] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.806886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 185/372] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.806886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.808347 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:55.930402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:55.934768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97521079-48f9-4644-a238-c6fe68f7d366 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:55.974238 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:55.975151 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:55.975431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:55.975705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:55.977642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:55.979118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:55.981138 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 186/373] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:55.981977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:56.029569 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667a8cf-8e2e-47d3-bea3-dadc99f705f1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:56.070060 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:56.071123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:56.071632 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:56.072100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:56.073151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] RBAC: Adding query filter params (role.id=427e9747b6874712bda332570b8bbf4a, user.id=761e9bc5ec014fe985a6a2db071433c0, scope.system=all) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:56.073669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:56.075370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:56.089444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 188/374] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/role_assignments?user.id=761e9bc5ec014fe985a6a2db071433c0&scope.system=all&role.id=427e9747b6874712bda332570b8bbf4a => generated 510 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:56.090625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:56.101636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf74e-90a6-4430-97bb-ecacedcad3e9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:56.109499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:56.159480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:56.160180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:56.160517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:56.160792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:56.201755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1d835-d521-4ca3-b2c5-c5db2591f4c6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:56.221708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:56.241568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:56.242907 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:56.243482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:56.243946 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:56.245470 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:56.247354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:56.249605 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 189/375] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:56 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:56.260253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:56.291990 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:56.291990 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:56.416282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:56.452192 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e796d-6431-4b75-b0ce-2d2ca591888d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:56.499096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:56.500017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:56.501180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:56.501463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:56.502372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=8e40113cb3bf457086033de57a227272) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:56.502634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:56.504177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:56.511045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 190/376] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:09:56 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:56.545828 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 187/377] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:09:56.551139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:56.680532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d86bc-3233-4732-a3c5-a7024f40cdd4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:56.722402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:56.723211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:56.723491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:56.723762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] PATH_INFO: `/v3/projects/7e8a212331754df2acc9d3192f9b6ccc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:56.724955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] RBAC: Authorizing `identity:get_project(project_id=7e8a212331754df2acc9d3192f9b6ccc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:56.727110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:56.728875 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 191/378] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:56 2022] GET /identity/v3/projects/7e8a212331754df2acc9d3192f9b6ccc => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:56.734460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:56.818005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:56.856223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89659b7-d474-4924-ad4c-89009122bb0a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:56.899149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849e3b6-332b-456f-b0d0-87402a59b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:56.900054 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849e3b6-332b-456f-b0d0-87402a59b4cb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:56.900337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849e3b6-332b-456f-b0d0-87402a59b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:56.900607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849e3b6-332b-456f-b0d0-87402a59b4cb None admin] PATH_INFO: `/v3/groups/5b98f1ab1e0242e7b535d435bdd84217` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:56.908478 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849e3b6-332b-456f-b0d0-87402a59b4cb None admin] RBAC: Authorizing `identity:get_group(group_id=5b98f1ab1e0242e7b535d435bdd84217)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:56.909987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849e3b6-332b-456f-b0d0-87402a59b4cb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:56.912127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 188/379] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:56 2022] GET /identity/v3/groups/5b98f1ab1e0242e7b535d435bdd84217 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:56.918107 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:56.938586 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:57.064687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951773c-beb8-4145-9ff8-745075d6def6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:57.108558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:57.109222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.109504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.109782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.110629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] RBAC: Adding query filter params (group.id=5b98f1ab1e0242e7b535d435bdd84217, role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=7e8a212331754df2acc9d3192f9b6ccc) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:57.110970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:57.112562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ef11b-f728-404c-ba81-c639c2f7827d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:57.123493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 192/380] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:09:56 2022] GET /identity/v3/role_assignments?group.id=5b98f1ab1e0242e7b535d435bdd84217&scope.project.id=7e8a212331754df2acc9d3192f9b6ccc&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:57.327436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073434-5e74-4b94-8ff5-850444c587a3 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.328132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073434-5e74-4b94-8ff5-850444c587a3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.328132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073434-5e74-4b94-8ff5-850444c587a3 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.329551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 189/381] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:57.341296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b15d-0b27-4637-a753-0e4b191ef4c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.341624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b15d-0b27-4637-a753-0e4b191ef4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.341839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b15d-0b27-4637-a753-0e4b191ef4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.365363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d447b15d-0b27-4637-a753-0e4b191ef4c4 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:57.366614 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d447b15d-0b27-4637-a753-0e4b191ef4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:57.476621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 193/382] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:57.511861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073434-5e74-4b94-8ff5-850444c587a3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:57.649298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073434-5e74-4b94-8ff5-850444c587a3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:57.687140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:57.694263 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:57.695185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.695474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.695754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.708415 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cbebf-f361-44af-a443-3f220458ceb4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.708701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:57.708914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cbebf-f361-44af-a443-3f220458ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.709089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cbebf-f361-44af-a443-3f220458ceb4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.711086 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 194/383] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:57.717258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:57.719553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:57.721561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 190/384] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:57.724945 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:57.725083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.725083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.725083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.761723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:57.762979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:57.770075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:57.880260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 195/385] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:57.911744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f4d45-97c2-4dc4-bb4e-4d61bbf5fcb1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:57.933299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:57.969901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:57.971643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:57.971938 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:57.972225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:57.973020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:57.973335 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:57.974821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:57.993189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 191/386] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:57.999733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.061137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338ee6a-5788-41c3-843c-5682a6327bfc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.102835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.104528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.105320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.105789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.114121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:58.119424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:58.128242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:58.129128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:58.129916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:58.133753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 196/387] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:58.139356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.140260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:58.230732 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa135-90f0-4db5-8db3-605d8aeafa72 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.267608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.269087 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.269564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.270047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.277031 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:58.282063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:58.284203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 192/388] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:57 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:58.291634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.354069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83166c4b-4769-45c8-b8b9-d389acfc5ef9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.400846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6d007-55aa-431e-8bb3-bb0ee12f8a36 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.426052 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:58.438194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.439129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.439516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.439894 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.441883 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:58.443373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:58.445403 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 193/389] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:58 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:58.446100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.446770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.447072 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.447340 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.448091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:58.448392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:58.450513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.459542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:58.472254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 197/390] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:58.478734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.548108 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:58.621437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f9f20-7e40-471e-9027-861f747b4731 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.659295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.660447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.660899 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.661471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.663449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:58.665389 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:58.667687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 198/391] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:58 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:58.672604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.691090 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b025-c5f6-4486-bdb4-61945a4da203 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.775516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.776778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.776778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.776953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.787616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6df3fcc135b54d5c8e2340a0237d6908, group_id=52922d431a254cdb919bbe1c0e9e64c1, role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:58.789151 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:58.789598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc934f-0ea6-474a-9cb6-83cc98437e55 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:58.820696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:58.826658 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 194/392] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:09:58 2022] PUT /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:09:58.828538 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf52ad-ec1c-43e5-abbb-70bc9ea986ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:58.829721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf52ad-ec1c-43e5-abbb-70bc9ea986ba None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.830225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf52ad-ec1c-43e5-abbb-70bc9ea986ba None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.830669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf52ad-ec1c-43e5-abbb-70bc9ea986ba None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.832225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf52ad-ec1c-43e5-abbb-70bc9ea986ba None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:58.834057 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf52ad-ec1c-43e5-abbb-70bc9ea986ba None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:58.837441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 199/393] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:09:58 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:58.843621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:58.942228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:58.963980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d381f-7de5-45b7-9fe7-1158b89376a6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.964326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d381f-7de5-45b7-9fe7-1158b89376a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.964547 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d381f-7de5-45b7-9fe7-1158b89376a6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:58.966686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 200/394] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:58.972918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e69491-e5ad-48f1-947d-1200d99b9dfd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:58.973202 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e69491-e5ad-48f1-947d-1200d99b9dfd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:58.973483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e69491-e5ad-48f1-947d-1200d99b9dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.005211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c4e69491-e5ad-48f1-947d-1200d99b9dfd None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:59.007047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c4e69491-e5ad-48f1-947d-1200d99b9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:59.036977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b243b89-d9b1-4ae0-a48c-0ef1877fb5e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:59.078028 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:59.078861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.079151 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.079426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/ad000b61baa1488c8cbae9dd0db42708` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.081414 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] RBAC: Authorizing `identity:create_grant(project_id=6df3fcc135b54d5c8e2340a0237d6908, group_id=52922d431a254cdb919bbe1c0e9e64c1, role_id=ad000b61baa1488c8cbae9dd0db42708)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:59.082899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:59.106831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 195/395] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:09:58 2022] PUT /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/ad000b61baa1488c8cbae9dd0db42708 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:09:59.119231 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 201/396] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:09:59.153849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:59.264585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7980b9-3511-4909-a396-de9f9deaf4c8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.265132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7980b9-3511-4909-a396-de9f9deaf4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.265554 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7980b9-3511-4909-a396-de9f9deaf4c8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.267136 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 202/397] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:09:59.286956 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.287467 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.287887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.311730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea947-10b8-444c-bc53-9d73c3861856 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:59.314622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:09:59.316859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:09:59.335930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:59.376086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:59.376909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.377194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.377465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.392529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:59.404084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:59.405425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:09:59.406214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:09:59.410497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 196/398] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:09:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:09:59.415453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:59.417917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 203/399] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:09:59.449971 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:59.534565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:59.588809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6011-a8e0-49ff-a50e-6b733efad679 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:59.618287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88097e91-edaf-4064-a46c-497d4d1146d6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:59.654282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:59.655370 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.655853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.656323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.657275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:59.657805 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:59.660481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:59.679557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 197/400] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:09:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:09:59.683347 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:59.685114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:59.686186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.688777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.689282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.710906 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:09:59.729162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:09:59.730191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:09:59.730979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:09:59.736118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 204/401] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:09:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:09:59.740433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:09:59.754180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:59.882255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6af2-7dc2-4bcb-a1fb-9a0c3b75db91 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:59.901219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:59.908994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799363-b80b-43c5-9fe2-5cf5554b0db0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:09:59.921895 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:09:59.922951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:09:59.923440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:09:59.923959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:09:59.924908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:09:59.925444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:09:59.927041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:09:59.936570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 205/402] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:09:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:09:59.944988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.001321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8a40e-1b6d-4254-b2b7-68655c568874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.002193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a40e-1b6d-4254-b2b7-68655c568874 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.002480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a40e-1b6d-4254-b2b7-68655c568874 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.002760 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a40e-1b6d-4254-b2b7-68655c568874 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.003993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8a40e-1b6d-4254-b2b7-68655c568874 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.005451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8a40e-1b6d-4254-b2b7-68655c568874 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.007385 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 198/403] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:59 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:00.012006 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950ada7-5dcc-465a-b64d-cb3506482a5d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.012319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950ada7-5dcc-465a-b64d-cb3506482a5d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.012583 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950ada7-5dcc-465a-b64d-cb3506482a5d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.013830 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 199/404] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:00.015768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950ada7-5dcc-465a-b64d-cb3506482a5d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.051949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1db60-7858-4619-b28c-b72c4714f6be None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.093219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875db4-fd51-4229-aa21-79901c0bb34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.094427 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875db4-fd51-4229-aa21-79901c0bb34b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.095042 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875db4-fd51-4229-aa21-79901c0bb34b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.095536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875db4-fd51-4229-aa21-79901c0bb34b None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.096941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0875db4-fd51-4229-aa21-79901c0bb34b None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.098615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0875db4-fd51-4229-aa21-79901c0bb34b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.105252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 206/405] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:09:59 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:00.106730 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.107478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.108096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.127041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:00.129002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:00.137538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:00.144517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950ada7-5dcc-465a-b64d-cb3506482a5d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.177937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:00.190529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.191440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.191727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.191999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.193918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.196332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.202268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 200/406] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:00 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:00.203694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.216742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 207/407] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:00.218020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.331708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2862e-0b3b-4788-85e0-d20f15222c99 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.332584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf8b9e-4b46-4c37-891a-3fa440b1c6b6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.367851 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.368725 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.369064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.369347 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.370544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.372017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.378149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 201/408] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:00 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:00.378149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.388348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.389891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.390644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.391144 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/ad000b61baa1488c8cbae9dd0db42708` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.394296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] RBAC: Authorizing `identity:create_grant(project_id=8e40113cb3bf457086033de57a227272, group_id=52922d431a254cdb919bbe1c0e9e64c1, role_id=ad000b61baa1488c8cbae9dd0db42708)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.396478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.418444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 208/409] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:10:00 2022] PUT /identity/v3/projects/8e40113cb3bf457086033de57a227272/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/ad000b61baa1488c8cbae9dd0db42708 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:00.419630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.425634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:00.495870 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:00.528889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f092-10e6-4e84-973f-46458b83ae1b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.585620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.586832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.587441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.587916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.599836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:00.608272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:00.609205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:00.610021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:00.612510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 202/410] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:00.618938 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.624879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e526fd-4b36-4539-958b-a5985914be2c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.700850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.701798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.702085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.702357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.704630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e40113cb3bf457086033de57a227272, group_id=52922d431a254cdb919bbe1c0e9e64c1, role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.706083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.723188 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 209/411] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:10:00 2022] PUT /identity/v3/projects/8e40113cb3bf457086033de57a227272/groups/52922d431a254cdb919bbe1c0e9e64c1/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:00.765719 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3618-cafa-4c29-92b2-04d661a69a76 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:00.768023 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:00.807671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:00.808361 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:00.808649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:00.808931 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:00.809712 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:00.810009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:00.811479 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:00.821554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 203/412] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:00.827794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:00.963559 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:00.970438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff715fb4-4e09-40d3-9fe3-139096dd08d0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:01.006222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:01.007661 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.007943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.008216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] PATH_INFO: `/v3/groups/5b98f1ab1e0242e7b535d435bdd84217` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.009423 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] RBAC: Authorizing `identity:get_group(group_id=5b98f1ab1e0242e7b535d435bdd84217)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:01.010911 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:01.012903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 210/413] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:10:00 2022] GET /identity/v3/groups/5b98f1ab1e0242e7b535d435bdd84217 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:01.017925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:01.125865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f05d-f884-4451-8d08-543410db3356 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:01.173393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff5d40-a147-4805-9f03-4a7376a1b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:01.174277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5d40-a147-4805-9f03-4a7376a1b29a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.174564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5d40-a147-4805-9f03-4a7376a1b29a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.174863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5d40-a147-4805-9f03-4a7376a1b29a None admin] PATH_INFO: `/v3/projects/7e8a212331754df2acc9d3192f9b6ccc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.176068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff5d40-a147-4805-9f03-4a7376a1b29a None admin] RBAC: Authorizing `identity:get_project(project_id=7e8a212331754df2acc9d3192f9b6ccc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:01.177534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff5d40-a147-4805-9f03-4a7376a1b29a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:01.180157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 204/414] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:01 2022] GET /identity/v3/projects/7e8a212331754df2acc9d3192f9b6ccc => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:01.187824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:01.330504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993b16-36ef-4e33-b7cd-7469ea833c1a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:01.374522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf5b1a-9096-4571-8718-89eb3fe726ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:01.375889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf5b1a-9096-4571-8718-89eb3fe726ec None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.376381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf5b1a-9096-4571-8718-89eb3fe726ec None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.376867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf5b1a-9096-4571-8718-89eb3fe726ec None admin] PATH_INFO: `/v3/projects/7e8a212331754df2acc9d3192f9b6ccc/groups/5b98f1ab1e0242e7b535d435bdd84217/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.384320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf5b1a-9096-4571-8718-89eb3fe726ec None admin] RBAC: Authorizing `identity:create_grant(project_id=7e8a212331754df2acc9d3192f9b6ccc, group_id=5b98f1ab1e0242e7b535d435bdd84217, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:01.386075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf5b1a-9096-4571-8718-89eb3fe726ec None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:01.421682 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 211/415] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:10:01 2022] PUT /identity/v3/projects/7e8a212331754df2acc9d3192f9b6ccc/groups/5b98f1ab1e0242e7b535d435bdd84217/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:01.564407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217518-efb9-4cd5-8279-2d6efae79c75 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.564951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217518-efb9-4cd5-8279-2d6efae79c75 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.564951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217518-efb9-4cd5-8279-2d6efae79c75 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.566721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 205/416] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:01.573116 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76d1b-211d-4fcb-98b3-c8a938064ce6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.573413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76d1b-211d-4fcb-98b3-c8a938064ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.573752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76d1b-211d-4fcb-98b3-c8a938064ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.592363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a7d76d1b-211d-4fcb-98b3-c8a938064ce6 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:01.593496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a7d76d1b-211d-4fcb-98b3-c8a938064ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:01.613080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:01.674946 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 212/417] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:01.691710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e9a56-6398-415d-acb6-37073fee9104 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.692046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e9a56-6398-415d-acb6-37073fee9104 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.692262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e9a56-6398-415d-acb6-37073fee9104 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.693639 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 206/418] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:01.699873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.700175 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.700442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.702186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e9a56-6398-415d-acb6-37073fee9104 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:01.733197 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:01.734401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:01.747177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:01.822904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 213/419] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:01.840405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e9a56-6398-415d-acb6-37073fee9104 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:01.877438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:01.902462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:01.904588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:01.904876 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:01.905155 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:01.927522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:01.947575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:01.948541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:10:01.949321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:01.950416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 207/420] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:01.955010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:02.025901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:02.055461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2261846-ad17-4a6e-bf5b-cbcb235e27a6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:02.100067 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:02.124530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:02.125344 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:02.125621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:02.125885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:02.131487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba802d7-a321-4890-b490-d733ff5b9a94 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:02.149721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:02.159970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:02.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:02.161644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 214/421] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:02.172765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:02.199941 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:02.200838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:02.201122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:02.201399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:02.203394 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:02.203706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:02.205088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:02.220029 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 208/422] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:02.229482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:02.363616 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7ed5-f846-4961-8987-603ea3fbdfe4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:02.423161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1897e5a-755d-43c7-83df-e342cec2d4cc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:02.426862 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:02.428455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:02.433014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:02.433448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:02.434365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:02.434865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:02.436407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:02.452254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 215/423] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:10:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:02.459610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:02.474177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:02.490383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:02.491468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:02.493072 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:02.494259 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:02.523296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:02.608037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:02.609507 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:02.651316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d30f-2a69-41d3-8832-b03cabbc36e4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:02.692195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:02.692850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:02.693133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:02.693404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:02.789581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:02.791425 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:02.799974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:02.820039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 209/424] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:02.826895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:02.903205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:02.942667 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 216/425] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:02.951770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:02.980490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769a48-baa6-40dd-a876-4a06407966cd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.050089 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.051152 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.051445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.052479 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.054293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:03.055781 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:03.059552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 210/426] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:02 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:03.064733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:03.118853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd769eb-a7b3-4644-a48e-81a39cb89357 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.134313 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:03.188094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.189412 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.190858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.192244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] PATH_INFO: `/v3/projects/6df3fcc135b54d5c8e2340a0237d6908` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.193824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] RBAC: Authorizing `identity:get_project(project_id=6df3fcc135b54d5c8e2340a0237d6908)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:03.197071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:03.199157 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 217/427] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:02 2022] GET /identity/v3/projects/6df3fcc135b54d5c8e2340a0237d6908 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:03.205783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:03.253939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98ac8b-6550-4f44-a778-0a81c2cb83da None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.308744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:03.331894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1583-060a-4e09-bc9a-64185d8e5661 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.355907 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.356791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.357079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.357356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.358551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:03.360031 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:03.361832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 211/428] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:03.371726 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:03.374198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.375629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.376102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.376543 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.379263 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:03.380980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:03.383741 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 218/429] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:03.395994 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:03.489339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ebec3-a2eb-424b-942c-8c4228901832 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.502196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:03.537473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.538154 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.538435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.538710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.539589 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:03.540482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:03.541964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd1f1b-c93d-4765-87dc-f0eb4adf4de5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:03.548367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 212/430] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:03.549660 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcd197-394f-4ca3-98b1-e0a634853310 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.549940 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcd197-394f-4ca3-98b1-e0a634853310 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.550216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcd197-394f-4ca3-98b1-e0a634853310 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.555104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 213/431] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:03.555104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9803eb-90aa-420a-9037-6860077ecb8a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.555104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9803eb-90aa-420a-9037-6860077ecb8a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.555104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9803eb-90aa-420a-9037-6860077ecb8a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.559324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 214/432] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:03.561175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.561323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.561515 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.580173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:03.581475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:03.582619 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca783-8c47-4ff2-977f-6d0be1b412e4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.631167 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.631874 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.632160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.632435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.633294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=6df3fcc135b54d5c8e2340a0237d6908) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:03.633610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:03.635153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969afd10-761e-4925-80bb-7a3325b67e0d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:03.640495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:03.645448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 219/433] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=6df3fcc135b54d5c8e2340a0237d6908&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 611 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:03.648412 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.648709 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.648989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.677962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:03.677962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:03.678586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 215/434] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:03.697531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:03.755513 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 220/435] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:03.784327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:03.831487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:03.888826 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d6297-6752-4b99-8465-0937f07e1f61 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.953381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e79f-ea33-43ef-849a-ec5ba32d4378 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:03.960763 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:03.962276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:03.962763 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:03.963362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:03.978037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:03.986721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:03.987644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:03.989199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 216/436] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:03.993542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.002002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.002885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.003107 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.003376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.024871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:04.034160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:04.035195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:04.035989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 221/437] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:04.042919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.054389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.147984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e509667-4f28-4be3-a552-232404b0350e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.179524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.197273 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ba43-4a02-42ed-9071-9c87e402cf22 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.213317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.214594 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.214594 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.214919 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.215696 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:04.216009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.217426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b817b8b-ba75-4e3e-87a5-9f66a3bda769 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:04.230174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 217/438] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:04.231424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0bd30-3623-48e8-a5ab-85f9e49da845 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.231718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0bd30-3623-48e8-a5ab-85f9e49da845 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.232082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0bd30-3623-48e8-a5ab-85f9e49da845 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.233657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 218/439] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:04.238890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0bd30-3623-48e8-a5ab-85f9e49da845 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.239957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.240859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.242568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.243362 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.243648 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:04.244139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.245328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240820fa-edff-468d-b8a5-ccd7fb1a6c93 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:04.256155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 222/440] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:04.257534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.257819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.258095 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.276797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:04.277913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:04.365532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 223/441] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:04.367007 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.383811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.386365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0bd30-3623-48e8-a5ab-85f9e49da845 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.429453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.430117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.430397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.430675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.473687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.486754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96caf3-f5f4-449b-9734-ec2c1b34c72f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.499728 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.501201 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:04.519073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.519717 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.519996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.520266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.601130 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.603158 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:04.613743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.618891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 219/442] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:04.619859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.694006 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.711877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 224/443] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:04.711877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.724987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f4847-af98-42a5-8ac6-42e4f7e88816 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.758874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.759659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.760011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.760294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.770544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:04.778835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:04.781877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 220/444] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:04.782705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.809127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9ad1-5f5e-4291-9ad0-81af143ef575 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.841404 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.844084 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.844943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.845219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.845490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.846676 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.848129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:04.849809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 225/445] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:04.850596 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.883463 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805fbb-6cc7-4231-a55c-c85b96b4c9f1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.914204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:04.917017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.917890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.918175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.918454 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] PATH_INFO: `/v3/projects/8e40113cb3bf457086033de57a227272` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.919699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] RBAC: Authorizing `identity:get_project(project_id=8e40113cb3bf457086033de57a227272)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.921159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:04.922891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 221/446] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/projects/8e40113cb3bf457086033de57a227272 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:04.923662 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:04.960476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5820cc-de64-47a1-8930-ef57bf1fdf3a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:04.994163 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:04.994845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:04.995131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:04.995406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:04.996150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:04.996454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:04.997822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.005859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 226/447] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:05.006660 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.028808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0eb5-82a8-4c80-971c-f08c5bf01b73 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.054532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:05.062509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.063389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.063676 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.063950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.065112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.066549 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.068170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 222/448] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:10:04 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:05.069022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.107936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4902a-c7c2-4c62-b46f-9c0e2ebec0f2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.124543 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:05.141641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.142422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.142699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.142997 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] PATH_INFO: `/v3/groups/52922d431a254cdb919bbe1c0e9e64c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.144397 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] RBAC: Authorizing `identity:get_group(group_id=52922d431a254cdb919bbe1c0e9e64c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.145844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.147999 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 227/449] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/groups/52922d431a254cdb919bbe1c0e9e64c1 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:05.148858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.170015 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edfff9-6b04-4fa2-83c1-8f196a8e846a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.201939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.202694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.203071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.203418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.246531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349db3c-ccba-411d-9213-cdf09b24a3c6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.263135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:05.270333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.271822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.280108 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.280783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.281073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.281350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.282184 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=8e40113cb3bf457086033de57a227272) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:05.282498 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.283958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.290494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 228/450] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:05.291090 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.368470 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:05.380818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 223/451] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:05.386990 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.430671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ce022-5ffd-4194-b1a7-ce39b09bcc5d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.472639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.472639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.472902 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.473140 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.474114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] RBAC: Adding query filter params (group.id=52922d431a254cdb919bbe1c0e9e64c1, role.id=ad000b61baa1488c8cbae9dd0db42708, scope.project.id=8e40113cb3bf457086033de57a227272) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:05.474646 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.475806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.482934 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 229/452] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/role_assignments?group.id=52922d431a254cdb919bbe1c0e9e64c1&scope.project.id=8e40113cb3bf457086033de57a227272&role.id=ad000b61baa1488c8cbae9dd0db42708 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:05.504254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:05.511916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c358a2-3a04-44b0-9597-fc636d6a981c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.553086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.553086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.553086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.553467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] PATH_INFO: `/v3/projects/7e8a212331754df2acc9d3192f9b6ccc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.554692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] RBAC: Authorizing `identity:get_project(project_id=7e8a212331754df2acc9d3192f9b6ccc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.556216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.557973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 224/453] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/projects/7e8a212331754df2acc9d3192f9b6ccc => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:05.563742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.671861 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb20e-14ec-488d-9ecc-a783bda2e212 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.689827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:05.713726 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f6518-2a54-4523-a9e9-7099f3fa37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.714577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6518-2a54-4523-a9e9-7099f3fa37cd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.714890 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6518-2a54-4523-a9e9-7099f3fa37cd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.715164 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6518-2a54-4523-a9e9-7099f3fa37cd None admin] PATH_INFO: `/v3/groups/5b98f1ab1e0242e7b535d435bdd84217` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.716335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f6518-2a54-4523-a9e9-7099f3fa37cd None admin] RBAC: Authorizing `identity:get_group(group_id=5b98f1ab1e0242e7b535d435bdd84217)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.717751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f6518-2a54-4523-a9e9-7099f3fa37cd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.719416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 230/454] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/groups/5b98f1ab1e0242e7b535d435bdd84217 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:05.725324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:05.829111 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfa453-1b60-4afa-b532-68d612283d20 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:05.862396 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:05.863082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:05.863361 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:05.863634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:05.864476 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] RBAC: Adding query filter params (group.id=5b98f1ab1e0242e7b535d435bdd84217, role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=7e8a212331754df2acc9d3192f9b6ccc) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:05.864787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:05.866760 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c931-515a-4d1b-8970-1453011c2eb2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:05.873017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 225/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:10:05 2022] GET /identity/v3/role_assignments?group.id=5b98f1ab1e0242e7b535d435bdd84217&scope.project.id=7e8a212331754df2acc9d3192f9b6ccc&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:08.760677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98022c-4310-4ac7-aae9-4eba6cc3bd23 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:08.761198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98022c-4310-4ac7-aae9-4eba6cc3bd23 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:08.761198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98022c-4310-4ac7-aae9-4eba6cc3bd23 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:08.762845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 231/456] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:08.768156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:08.769277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:08.769764 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:08.800198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:08.801725 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:08.823790 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0907-7c19-4edc-adf1-8e5209bd55a3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:08.824392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0907-7c19-4edc-adf1-8e5209bd55a3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:08.824879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0907-7c19-4edc-adf1-8e5209bd55a3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:08.826693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 232/457] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:08.836080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925a22-4821-4e99-897b-3b93da744cd3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:08.836399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:08.836965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925a22-4821-4e99-897b-3b93da744cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:08.837789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925a22-4821-4e99-897b-3b93da744cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:08.867784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-04925a22-4821-4e99-897b-3b93da744cd3 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:08.869111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-04925a22-4821-4e99-897b-3b93da744cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:08.904674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 226/458] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:08.941054 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:08.955862 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 233/459] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:10:08.961814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e8095-38d5-4e80-8ebd-28ed459693bf None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:08.961814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e8095-38d5-4e80-8ebd-28ed459693bf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:08.961814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e8095-38d5-4e80-8ebd-28ed459693bf None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:08.961814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 234/460] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:08.965355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaee00-3842-4368-9518-8604393342f0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:08.965635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaee00-3842-4368-9518-8604393342f0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:08.965903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaee00-3842-4368-9518-8604393342f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:08.983139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4afaee00-3842-4368-9518-8604393342f0 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:08.984305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4afaee00-3842-4368-9518-8604393342f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:09.063954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 235/461] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:10:09.065106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaee00-3842-4368-9518-8604393342f0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.097285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29812995-76d4-4569-b28f-017e0c44b55e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.114869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.135834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.136726 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.137004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.137274 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.149269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.150843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:09.170817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:09.171753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:09.172617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:09.172617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:09.172617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:09.172617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:09.177053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 227/462] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:09.178026 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.191805 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.195164 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaee00-3842-4368-9518-8604393342f0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.232523 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.233689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.233888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.234129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.245085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.246635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:09.266132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:09.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:09.267893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:09.267893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:09.267893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:09.267893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:09.273249 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 236/463] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:09.273834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.309644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e37a-2f01-4dc0-a325-45f1c3fa0141 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.353793 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.354518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.354834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.355109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.366232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.367735 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.376372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.384677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87492-1884-4066-bc4d-65afc9659f3b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:09.386822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:09.387637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:09.388550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:09.388550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:09.388550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:09.388550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:09.388550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 228/464] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:09.388815 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.425816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.426475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.426753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.427068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.427785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:09.428088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.429972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618c1b9-1abb-421e-9a56-f9fca1420c04 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.442125 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 237/465] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:09.448515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f75f-552e-47d3-9c75-8028a74e4482 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.448813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f75f-552e-47d3-9c75-8028a74e4482 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.449098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f75f-552e-47d3-9c75-8028a74e4482 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.450823 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 238/466] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:09.451064 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f75f-552e-47d3-9c75-8028a74e4482 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.462229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.504219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605e77-765b-4b6b-b776-ee077ed85380 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.540894 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.541712 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.542269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.542547 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.543310 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:09.543615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.545408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.558359 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f75f-552e-47d3-9c75-8028a74e4482 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.564022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 229/467] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:09.564022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.603422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.604654 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.604938 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.605215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.606276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:09.606603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.608707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebee6f-c830-422e-90dc-4a870ef41037 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.626933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 239/468] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:09.628625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.628911 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.629214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.645837 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:09.647029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:09.657408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.670585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a999c-4335-47b9-b1de-c6f508062762 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.698226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.711523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.712114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.712399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.712693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.713385 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.714999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.726830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 240/469] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:09.726830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.743404 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 230/470] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:10:09 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:09.744552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.878392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a198-94a4-4c50-99c8-07494949fe58 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.882410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a722ece-0f89-4f27-a21c-fd75118adf43 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:09.917440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.918317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.918673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.919056 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.919847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.921177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9e42a-462d-493d-9e7f-6ecca5d8e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:09.921471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.921855 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e42a-462d-493d-9e7f-6ecca5d8e2f0 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.922135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e42a-462d-493d-9e7f-6ecca5d8e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.922403 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e42a-462d-493d-9e7f-6ecca5d8e2f0 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.923141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9e42a-462d-493d-9e7f-6ecca5d8e2f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:09.924585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9e42a-462d-493d-9e7f-6ecca5d8e2f0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:09.939824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:09.946752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 241/471] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:10:09 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:09.948119 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 231/472] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:10:09 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:09.949012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:09.950333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c4cf4-763b-4893-a857-45a64dba6c0d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.950642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c4cf4-763b-4893-a857-45a64dba6c0d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.955053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c4cf4-763b-4893-a857-45a64dba6c0d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.956977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 232/473] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:09.968379 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:09.968731 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:09.968931 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:09.999569 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:10.001067 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:10.044280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:10.090749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6430504-44c3-4419-b058-c8a617f9c692 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:10.113840 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 233/474] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:10.141959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:10.142701 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:10.143019 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:10.143560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:10.157355 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:10.157541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:10.158894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:10.182332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:10.183272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:10.184094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:10.184094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:10.184094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:10.184094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:10.184298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 242/475] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:10.189774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:10.260558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:10.304535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a213d76-e8e1-49cc-81b8-2812cd006e24 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:10.326735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7ac8-7a04-4942-bd90-4c0f6cba8e08 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:10.352015 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:10.353342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:10.354283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:10.355112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:10.356359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:10.358570 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:10.366405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.sql.core [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:10:10.366405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:10:10.366405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [parameters: {'id': '49559fb46927439b97a6db43e0d58332', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:10:10.366405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80246) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:10:10.372917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:10.373870 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:10.374375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:10.374913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:10.375926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:10.376432 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:10.378120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() May 19 14:10:10.382557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return ref.to_dict() May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:10:10.383465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application yield resource May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise self.value May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application session.commit() May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:10:10.384367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.flush() May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application compat.raise_( May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:10:10.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:10:10.387139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:10:10.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [parameters: {'id': '49559fb46927439b97a6db43e0d58332', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:10.390757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:10:10.394079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:10.394918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 234/476] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:10:10 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:10.394918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:10.408281 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 243/477] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:10.415258 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:10.433348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:10.511748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc350-2375-4841-bd44-1464f1755367 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:10.532901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d20f2e-86be-49ea-be50-cf3b5af685a3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:10.548327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:10.550748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:10.551854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:10.552333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:10.552808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:10.564688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:10.572204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace0b5-89c2-4128-80cd-fe80bd59fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:10.572879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace0b5-89c2-4128-80cd-fe80bd59fef1 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:10.573165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace0b5-89c2-4128-80cd-fe80bd59fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:10.573442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace0b5-89c2-4128-80cd-fe80bd59fef1 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:10.574156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace0b5-89c2-4128-80cd-fe80bd59fef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:10.574892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:10.575770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:10:10.576548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:10.577141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace0b5-89c2-4128-80cd-fe80bd59fef1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:10.579299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 235/478] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:10.585807 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:10.617888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 244/479] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:10:10 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:10.693342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:10.703705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41d131-2f0e-4bd5-a1dd-945000141181 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:10.753067 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:10.753765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:10.754041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:10.754309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:10.755100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:10.755405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:10.757342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2274-6b44-4b72-9cce-5dcb65213ab7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:10.771531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 236/480] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:12.672319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cb8b8-0432-4612-9ac8-8f388c5227d8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:12.672811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cb8b8-0432-4612-9ac8-8f388c5227d8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:12.672811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cb8b8-0432-4612-9ac8-8f388c5227d8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:12.674414 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 245/481] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:12.683331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:12.683838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:12.683942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:12.712044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:12.713339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:12.763738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff7ef-00f0-444e-9d76-0ddd6e7dc4e0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:12.764039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff7ef-00f0-444e-9d76-0ddd6e7dc4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:12.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff7ef-00f0-444e-9d76-0ddd6e7dc4e0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:12.765930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 246/482] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:12.771091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d295-fc84-4c78-8f2c-02c814146c33 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:12.771380 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d295-fc84-4c78-8f2c-02c814146c33 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:12.771655 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d295-fc84-4c78-8f2c-02c814146c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:12.793147 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 237/483] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:12.804610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5ed0d295-fc84-4c78-8f2c-02c814146c33 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:12.805798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5ed0d295-fc84-4c78-8f2c-02c814146c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:12.824125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:12.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 247/484] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:12.915577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5397-8adf-43e1-a2b9-305488a028d7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:12.915869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5397-8adf-43e1-a2b9-305488a028d7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:12.916150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5397-8adf-43e1-a2b9-305488a028d7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:12.917780 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 248/485] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:12.922494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:12.922765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:12.923021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:12.940765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:12.942030 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:12.975418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:12.998889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c085e-599a-4e30-82c4-2622e072d7fb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.030810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 249/486] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:13.030810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.049913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.051055 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.051620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.052106 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.064786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.064943 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:13.073224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:13.074161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:13.074958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 238/487] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:13.075622 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.146622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884a5c4-84a2-4942-9352-48e892387f3e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.182943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.183957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.184399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.184808 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.191532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b9e94-b54d-48f5-b3b1-61c294da1994 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.196616 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:13.204637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:13.205506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:13.206291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:13.209018 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 250/488] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:13.214651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.230501 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.231659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.232198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.232618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.245824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.250455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:13.260470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:13.261617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:13.262431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:13.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 239/489] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:13.271773 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.315394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.328564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e16b-50d4-4a3c-95a3-dc657c1e0568 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.362816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.363652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.364067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.364442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.365291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:13.366225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.367954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.376469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 251/490] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:13.377495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.388443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d65d7d-0b6c-41f2-9411-b6d04345ab4c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.432532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.433145 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.433369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.433641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.434469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:13.434693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.436159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.448925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 240/491] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:13.448925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.499598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d01c0-3689-43ad-a21d-578388fd7de6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.511844 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.543344 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.544004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.544275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.544545 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.545289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:13.545592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.546989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.554751 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5e576-fdf8-48c8-aebf-3ea70560e1ca None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.554902 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 252/492] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:13.559953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.575693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.602303 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.603196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.603584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.603862 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.617637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d5d7cc76-9ff8-4d85-9fc9-5012235f3d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:13.636598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:13.637481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:13.638315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:13.638315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:13.638315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:13.638315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:13.638315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 241/493] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:13.639312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94d32-3ac7-4ba4-8f6c-c6b58d49a7f0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.639413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94d32-3ac7-4ba4-8f6c-c6b58d49a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.639632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94d32-3ac7-4ba4-8f6c-c6b58d49a7f0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.641025 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 242/494] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:13.645996 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf94d32-3ac7-4ba4-8f6c-c6b58d49a7f0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.673310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07065-c908-4db1-bf8a-c88ec94c7d30 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.708246 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.708958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.709796 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.710070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.720876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.722313 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:13.739923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:13.741440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:13.742941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:13.742941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:13.742941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:13.742941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:13.742941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 253/495] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:13.742941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.768865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf94d32-3ac7-4ba4-8f6c-c6b58d49a7f0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.783639 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.804625 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.805709 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.805982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.806743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:13.816716 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.818168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2cc98459-6aef-4a0d-bd97-cae1bf2a8c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:13.836022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:13.836865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:13.837839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:13.837839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:13.837839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:13.837839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:13.837839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 243/496] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:13.838816 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8d10-5523-4925-8ac3-a3bb65a0a561 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.839167 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8d10-5523-4925-8ac3-a3bb65a0a561 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.839385 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8d10-5523-4925-8ac3-a3bb65a0a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.854103 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88295a48-bf68-414c-9510-7d7c5b26ac2d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:13.857545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3e9b8d10-5523-4925-8ac3-a3bb65a0a561 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:13.859042 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3e9b8d10-5523-4925-8ac3-a3bb65a0a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:13.894954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:13.895850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.896279 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.896754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.898146 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:13.898597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:13.900136 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:13.913235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 254/497] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:13.914300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:13.938009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 244/498] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:13.939865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a4185-bf15-4185-957f-c6af7b889fda None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:13.940286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a4185-bf15-4185-957f-c6af7b889fda None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:13.940765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a4185-bf15-4185-957f-c6af7b889fda None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:13.942218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 245/499] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:13.944469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a4185-bf15-4185-957f-c6af7b889fda None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.035974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3165-9fb4-4ed8-85ff-15b5a0019b89 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.062304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.064237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.072405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a4185-bf15-4185-957f-c6af7b889fda None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.075696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.078555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.078867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.079147 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.079880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:14.080187 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.081586 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.093577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 255/500] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:14.094391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.115295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.116078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.116431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.116775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.117576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:14.117951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.119533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a741163-9b71-4a7f-a6c5-ef4420c4acbb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.132176 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 246/501] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:14.133520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.133871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.134201 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.156237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:14.157438 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:14.201963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637500b2-addc-4221-898a-b577a39cf16b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.225438 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 247/502] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:14.226166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.238383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.239274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.239835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.240122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.247829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.249448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:14.264839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:14.265736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:14.266627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 256/503] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:14.267467 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.311183 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.316485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.327332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011e07-058c-4abd-b8f0-6cedda78d2d2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.361141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.361930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.362212 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.362482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.370469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f69b39-1dbc-40b1-860f-d337e5023b5b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.372712 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:14.380441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:14.382020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:14.383109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:14.387072 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 248/504] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:14.387888 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.406361 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.407178 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.407451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.407716 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.415196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.416634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:14.430455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:14.431534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 257/505] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:14.432610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.492901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117e326-3aac-44a9-a9b3-73307993faf8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.527332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.528123 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.528410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.528685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.531785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca4b8-bcb4-4434-9eec-49f75eb7848e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.534059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.536242 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.537748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:14.553117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:14.554008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 249/506] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:14.555162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.564455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.570434 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.571254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.571534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.571806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.582202 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.583658 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:14.600842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:14.601672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:14.602511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:14.602511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:14.602511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:14.602511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:14.602511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 258/507] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:14.603166 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.660282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f869ef-cafd-457a-b83e-2fa0324b3cc2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.693088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.694386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.694671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.694977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.695822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:14.696126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.698271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.701573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40724f48-abc3-4599-8b50-afcee7d3548b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.733877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 250/508] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:14.734702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.734998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.735797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.736214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.736633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.737503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:14.737931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.739475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.748079 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 259/509] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:14.749058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.767957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.799621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:14.837769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2240c-1ae1-4860-95ed-949528a14590 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.848033 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c013c2-3445-4dde-befd-4abd68c856fc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:14.871166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.871831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.872110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.872381 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.873222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:14.873529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.875078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.880700 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:14.881926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:14.882205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:14.882486 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:14.883572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:14.883881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:14.885305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:14.895341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 251/510] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:14.896167 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.925060 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 260/511] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:14.925898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:14.997151 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77998092-fd66-4d4c-ab1f-b22ecc1c0017 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.001420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.019951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.025329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df58e1-6b02-4a5f-a45b-820a9bffa088 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.031401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.032061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.032350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.032628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.033350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:15.033657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.035061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.046525 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 252/512] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:15.047412 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.059575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.060218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.060498 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.060774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.127609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.128984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.148224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09444ad8-a6ed-4ce3-945e-9d3f11018077 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.181498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.182275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.182551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.182832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.193095 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.194634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.201677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:15.212075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:15.212920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:15.213752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:15.213752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:15.213752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:15.213752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:15.213752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 253/513] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:15.214024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.226019 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 261/514] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:15.226868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.253789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.320322 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f03e-fe45-422e-89eb-f506196f2c4e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.323933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699deec-5132-4156-99e7-622453bbd278 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.353695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.354336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.354621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.354924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.357042 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.357705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.357984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.358253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.403875 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.425017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.426659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.426875 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.428877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.458606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.525232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 254/515] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:15.526041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.527449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 262/516] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:15.528548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.603395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.626271 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441d0c-3859-437d-865b-d4d764a321e1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.626949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff7222-0f0c-489c-b65b-10120fcd0f7a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.660083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.660664 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.660869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.660978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.661197 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.661536 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.661821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.661918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:15.662095 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.662222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.663393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.664145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.664874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.671454 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.675420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 263/517] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:15.676208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.685247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 255/518] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:10:15 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:15.686237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.793821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54ba0-e9bb-4429-a218-23e41acf7b69 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.802649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e6ed5-28c7-4f98-a20c-13a47470c83f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:15.833699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.835022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.835306 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.835624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.839025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.843920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:15.844747 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:15.845034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:15.845311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:15.849462 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.851032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:15.860942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:15.869481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:15.870325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:15.871643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:15.871643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:15.871643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:15.871643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:15.871643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 264/519] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:15.872109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:15.886861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:15.887722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:15.888554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:15.888554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:15.888554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:15.888554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:15.890264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 256/520] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:15.891328 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:15.946416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:15.987566 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05fbf1-3a91-40d1-9428-274ab2f7adb3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.013738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac2679-00ec-467c-89ca-203e03208cfa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.023872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.024665 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.024949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.025225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.035831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.037811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.050852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.051658 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.051944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.052219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:16.056004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:16.056829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:16.057650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:16.057650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:16.057650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:16.057650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:16.060568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.061748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 265/521] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:16.062096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.062517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:16.078954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:16.079898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:16.080771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 257/522] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:16.081348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.118391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.183941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f09d84-734a-465f-9783-253d7f67ab49 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.189761 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54261103-28a5-4546-9dbb-67da28063c4f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.191371 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.222481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.223236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.223523 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.223799 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.224525 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:16.225397 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.225509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.226116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.226399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.226673 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.226763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.227434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:16.227741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.229116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.242557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 258/523] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:16.243730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.245133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 266/524] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:16.245965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.349488 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.353068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c20a3-277c-42c3-a8af-b4cc6fc15776 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.359934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880f43-071e-4c48-bd65-4da63c236017 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.389647 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.390314 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.390595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.391110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.391749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:16.392059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.393786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.396383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.397077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.397369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.397646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.398377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:16.398685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.400108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.414271 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 267/525] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:16.415496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.422964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 259/526] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:16.425848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.452320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.532707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f072f-5b39-4209-bb7e-bc926afe4733 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.534241 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdb970-425d-4bae-b258-3cb5e6c02c42 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.567827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.569193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.569475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.569745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.570373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.571453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.571903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.572323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.576898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.578345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.580081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.581669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:16.593124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:16.594137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:16.595208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:16.598961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 268/527] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:16.600225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:16.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:16.602209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:16.602724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.608630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 260/528] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:16.609619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.621663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.701314 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.711133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e95b0-62b5-4244-96e4-7ba291fa79b1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.720283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33036-52e2-4451-ad3e-4da75826bd3a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.747409 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.748058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.748342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.748616 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.756409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.757201 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.757481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.757751 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.764821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.766299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:16.782082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:16.783069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:16.783928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 261/529] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:16.784952 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.832672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.834214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.853993 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:16.892377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9dea-4e40-434d-aab2-3872d2fb33c1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:16.930682 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:16.931460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:16.931746 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:16.932025 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:16.932806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:16.933229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:16.934668 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:16.949652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 269/530] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:16.949652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.958461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 262/531] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:16.959914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:16.962704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:17.067631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cd341-e146-4463-9cd1-741c568d9334 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.070552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2fcc6-14c8-44e7-a0de-3f874636a9b0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.090520 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:17.108329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.108875 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.109013 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.109257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.109523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.109626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.109800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.110098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.110304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:17.110605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.110882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:17.111190 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.112256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.112599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.129248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 263/532] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:17.129248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.133202 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 270/533] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:17.133869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.198241 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:17.238900 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac88a6-28be-4511-a04e-e4daf0670fff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.243707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63781293-cb0b-4bef-b4c3-82acde628237 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.274333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.275228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.275513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.275789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.279436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.280114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.280395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.280667 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.281529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=ff0e8e8eafa44aa294538c43527190d8) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:17.281841 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.283314 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.288199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 271/534] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/role_assignments?user.id=ff0e8e8eafa44aa294538c43527190d8&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:17.299285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.299392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:17.319112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:17.320173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:17.321020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:17.321020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:17.321020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:17.321020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:17.321537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 264/535] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:17.322563 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.360849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:17.440729 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfd78f-14f4-4f89-bf95-0b579c900df4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.467898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4be3b-9f6a-47e7-b03b-6a25588db213 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.484565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.485160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.485445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.487162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:17.487272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.487756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=d3795d052ce442e9b20dc5f5ed810d37) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:17.488365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.489998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.502933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 272/536] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/role_assignments?user.id=d3795d052ce442e9b20dc5f5ed810d37&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:17.504047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.513352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.514048 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.514333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.514608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.517081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=157ade8895fa46d3b76023831c24a4a0) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:17.517409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.519807 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.528718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 265/537] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/role_assignments?user.id=157ade8895fa46d3b76023831c24a4a0&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:17.632974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebbac-63d4-4fe2-9be3-b92a7a7d0956 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.641355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:17.675002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.675691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.675976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.676253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.677010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:17.677319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.679353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.694735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 273/538] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:17.700382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.839002 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e051-98ac-4fce-8cf4-ca348433806f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:17.881328 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:17.882491 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.883075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.883542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.894064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:17.896238 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-15cb1eca-00e8-41d3-81bd-fb6523f0a368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:17.915552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:17.916444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:17.917279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:17.919467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 266/539] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:17.925099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:17.988541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63ac0-ea9c-4810-81c1-dc87fb68ca04 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.988854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63ac0-ea9c-4810-81c1-dc87fb68ca04 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.989093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63ac0-ea9c-4810-81c1-dc87fb68ca04 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:17.990606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 267/540] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:17.995992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:17.996603 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:17.997080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:18.048524 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:18.050083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:18.066816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a2307-bd50-49a4-b5bb-1ca7951b398c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:18.101405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:18.102068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:18.102348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:18.102621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:18.104007 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:18.104320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:18.105825 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:18.120847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 274/541] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:18.126892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:18.133538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:18.158744 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:18.221004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 268/542] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:10:18.238694 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c2f9-9637-42f1-aac3-c4a0c29a6e4d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:18.263430 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:18.275994 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:18.276655 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:18.276936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:18.277211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:18.278055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=942d20017757425787011a2b41dbb5f3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:18.278367 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:18.279845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:18.286411 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 275/543] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:18 2022] GET /identity/v3/role_assignments?user.id=942d20017757425787011a2b41dbb5f3&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:18.410833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065bbf-6eb6-413b-9254-6781bea8cd18 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:18.444664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:18.445470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:18.445747 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:18.446022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:18.457423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:18.465363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:18.466254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:18.467074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:18.471129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 269/544] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:18.472873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:18.593630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:18.604627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270de16-34cb-4b0b-b382-3182115017ae None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:18.643511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:18.644181 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:18.644459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:18.644732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:18.645483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:18.645787 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:18.647326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:18.662108 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 276/545] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:18.667790 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:18.727387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:18.895239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff90e2-d277-4f98-853a-dfed9c9814d9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:18.972656 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:18.973975 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:18.975023 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:18.975511 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:19.000960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:19.003641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:19.048772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:19.050408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:19.053512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:19.053512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:19.053512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:19.053512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:19.053512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 270/546] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:19.057610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:19.292531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b0f5-684b-4643-a991-f1b043aa9f46 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:19.343653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:19.344316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:19.344595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:19.344864 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:19.345587 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:19.345889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:19.347285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:19.366248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 277/547] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:19.372312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:19.529663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:19.564927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53dcd6-753d-414a-8951-dfba6198282e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:19.623190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:19.624471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:19.624955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:19.625426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:19.638722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:19.641408 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:19.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:19.671585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:19.673886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 271/548] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:19.680121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:19.710289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:19.834905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2730-7a16-4f15-91df-ba7a96bd7389 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:19.880360 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:19.881600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:19.881880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:19.882150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:19.883063 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:19.883368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:19.884778 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6ee1-cdb1-412a-a0ac-f102ca380b25 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:19.908069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 278/549] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:10:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:19.913699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.057085 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cace68-2576-408c-b239-af79cb60cddd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.095923 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.096539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.096831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.097108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.109565 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.137390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3e69-3b5f-4a13-a12e-2208d67b28e7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.138372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3e69-3b5f-4a13-a12e-2208d67b28e7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.138898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3e69-3b5f-4a13-a12e-2208d67b28e7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.140751 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 279/550] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:10:20.146453 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.147062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.147562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.165988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:20.167917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:20.179762 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.181226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:20.236832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.243290 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 280/551] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:20.266885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.286531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 272/552] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:20.292017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.335457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.373201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1ad8-3172-4003-8962-1b1874b101bb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.399158 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075e78-e933-452f-aa96-8ddeff05e5b1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.419670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.420803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.421285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.421769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.433594 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:20.433749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.434495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.434776 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.435074 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:20.442617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:20.444143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:20.445321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:20.445978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.447245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:20.448300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 281/553] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:20.454065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:20.467271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:20.468236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:20.469180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:20.469180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:20.469180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:20.469180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:20.469180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 273/554] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:20.475809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.522802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.569702 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d1fb8-87af-48d1-906d-891ed546edfd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.603099 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.606427 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.610826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.610826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.610826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.610826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:20.610826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.610826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:20.614910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5647b-9ea4-4ddf-a4f9-c0e0bec43f45 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.620248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 282/555] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:20.628363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.684076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.685137 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.685617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.686113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.687263 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:20.687768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.689377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:20.712080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 274/556] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:20.717738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.742922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccecc3c-ef00-4d76-bb1b-c61160a85ed9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.769364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.782515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.783282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.783556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.783822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.798368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.799862 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-dbbffbc0-7dfb-48f9-bb90-a10bf89d0223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:20.819350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:20.820776 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:20.821749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:20.821749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:20.821749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:20.821749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:20.821749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 283/557] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:20.822494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e6ec7-dea7-461f-89f8-40364c634a45 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.822494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e6ec7-dea7-461f-89f8-40364c634a45 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.822752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e6ec7-dea7-461f-89f8-40364c634a45 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.828325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 284/558] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:20.829138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e6ec7-dea7-461f-89f8-40364c634a45 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:20.857691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bd98c-69ae-4b58-84b4-4c1dc7ea2cef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.899558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.900776 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.901266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.901754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.910089 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.912379 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0ce7621e-52eb-47eb-a469-04cb2198dc61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:20.929149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:20.930520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:20.931627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:20.938445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 275/559] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:20.940015 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.940544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.940949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e6ec7-dea7-461f-89f8-40364c634a45 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:20.941140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.959295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:20.960964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:20.980681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:20.988863 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:20.990224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:20.991155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:20.991675 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:20.993279 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:20.993798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:20.996143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.012512 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 285/560] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:21.014246 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.050811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 276/561] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:21.050811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.073113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.154894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09525-1026-4fd6-9226-07bc28ea8082 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.166519 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db18bb-c4d6-4fd7-885f-928abc4dd2c1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.196286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.196966 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.197256 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.197533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.198356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:21.198660 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:21.200158 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.207604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.208453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.209284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.209565 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.218103 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 286/562] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:21.218103 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.219777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:21.221236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c9795d12-1e87-475f-8f3f-9f7a326479e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:21.236804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:21.237792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 277/563] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde784e0-87ab-455a-ba4d-6ee7bdbc7b46 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.243566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde784e0-87ab-455a-ba4d-6ee7bdbc7b46 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.244280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde784e0-87ab-455a-ba4d-6ee7bdbc7b46 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.244280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 278/564] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:21.244280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde784e0-87ab-455a-ba4d-6ee7bdbc7b46 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.246012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.324666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.332749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3960d5-e53d-4693-a847-7776bcc716a8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.357175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde784e0-87ab-455a-ba4d-6ee7bdbc7b46 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.368396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.369182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.369459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.369727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.379707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:21.388003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:21.389126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:21.390004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 287/565] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:21.391117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.391830 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.392487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.393035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.393313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.394150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=2d851c6ec2514bdd8660b352254a7965) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:21.394464 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:21.395934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1b1a6-1b56-4d98-a64b-e2aa5532cb71 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.414916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 279/566] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/role_assignments?user.id=2d851c6ec2514bdd8660b352254a7965&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:21.414916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aab90-8e0d-475f-9686-288984098bbd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.414916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aab90-8e0d-475f-9686-288984098bbd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.414916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aab90-8e0d-475f-9686-288984098bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.422697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b26aab90-8e0d-475f-9686-288984098bbd None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:21.424126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b26aab90-8e0d-475f-9686-288984098bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:21.501621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.514886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 280/567] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:21.516679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70860bc-3fbc-4582-a403-dcaf1388af52 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.518926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70860bc-3fbc-4582-a403-dcaf1388af52 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.519219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70860bc-3fbc-4582-a403-dcaf1388af52 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.520814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 281/568] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:21.522747 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70860bc-3fbc-4582-a403-dcaf1388af52 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.533212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16639aef-5e1c-45e3-9c91-28ea1278e481 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.573535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.574220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.574503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.574782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.575663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:21.575975 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:21.577428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ae566-5aa4-4f86-b6f4-3a0ec6bae4d5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.597102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 288/569] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:21.598560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.598950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.599366 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.617686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:21.618894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:21.627220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.643831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70860bc-3fbc-4582-a403-dcaf1388af52 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.682404 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.683442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.683731 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.684169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.684930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:21.685243 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:21.686669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.698832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 289/570] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:21.698832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.699072 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 282/571] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:21.699072 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.761349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.811858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242407f1-3e44-4df6-ac24-12483f48687d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.814851 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81542a-703e-47cf-a2b2-af13de626b7f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:21.847238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.848388 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.848869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.849892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.851556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:21.852350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:21.852634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:21.852906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:21.861459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:21.863945 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:21.866035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:21.870537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:21.871633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:21.872643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:21.874587 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 290/572] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:21.875528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.878566 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:21.888704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:21.889803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:21.890775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:21.890775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:21.890775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:21.890775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:21.890775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 283/573] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:21.891093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:21.994710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2529f-a9e1-4137-9571-8ce394d30d23 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.003174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fcc9e-3c39-42ca-bf40-370477fae484 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.013809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.032303 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.033091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.033369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.033638 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.039598 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.040682 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.041113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.041535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.045745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.047276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.055012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:22.063122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:22.064127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:22.070221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:22.070951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:22.071733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:22.073014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:22.073014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:22.073014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:22.073014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:22.073241 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 284/574] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:22.073241 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.073365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 291/575] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:22.073365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.132023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.178387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e32be-0700-49b2-8481-cde5dd4d28f2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.178613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bcc9-ce9f-4e4e-b124-293d1dc574ff None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.213128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.213332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.213799 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.213904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.214070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.214165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.214343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.214447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.215139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:22.215236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:22.215445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.215550 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.216803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.216912 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.233191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 285/576] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:22.233191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.234223 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 292/577] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:22.235132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.265350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.334882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afac07b-4dd9-448e-a9df-2099b4e3165a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.335340 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188860-0349-47b5-9935-86a77a589415 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.350213 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.370428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.371134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.371420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.371715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.372477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:22.372784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.373511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.374153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.374484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.374947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.375354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.376237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:22.376544 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.377887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.386579 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 286/578] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:22.386579 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.392998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 293/579] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:22.397903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.493077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.502365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ece833-f222-49e5-8dec-d12d2cf27bf7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.504635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34658449-0766-4c32-b7ff-79054f8c735c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.541437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.541768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.542160 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.542442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.542540 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.542708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.542835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.543073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.550769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.552647 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.553783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.555494 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:22.566881 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:22.567760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 294/580] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:22.573940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:22.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:22.575360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:22.579100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:22.579100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:22.579100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:22.579100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:22.579100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 287/581] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:22.579100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.609584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.682503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65620-bd69-48bd-83b6-33350f430fbe None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.686630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3faa3-d2a5-4b61-8327-4eba6afc31bd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.719631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.720419 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.720700 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.720974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.722605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.723457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.723753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.724025 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.731649 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.731867 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.733085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.733249 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:22.748326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:22.749250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:10:22.750204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:22.751236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:22.752053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:22.752936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:22.752936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:22.752936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:22.752936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:22.754251 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 288/582] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:22.755056 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.755223 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 295/583] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:22.756769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.766272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.844399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:22.859705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058487-be58-4463-9029-c07f96f2c3c0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.869521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f1a69-a7b9-408a-b507-748528e4d776 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:22.895310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.896091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.896476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.896768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.897504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:22.897814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.899212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.906865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:22.907533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:22.908112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:22.908112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:22.908927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:22.909160 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:22.910585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:22.911639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 296/584] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:22.912806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:22.933111 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 289/585] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:22.933111 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.006409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.030180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd57d6-e998-45d8-a083-de9a1f412bcd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.043030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abdf85-2e0a-4681-9af4-c3cf1c785255 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.067151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.067828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.068677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.068956 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.069791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:23.070214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.071775 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.078971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.079636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.079917 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.080193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.080916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:23.081232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.082573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.094560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 297/586] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:23.094560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.096118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.098953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 290/587] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:23.103449 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.202151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec49d4-9768-4b41-8914-ed1f200b686e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.208772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e83c-7fe1-4b54-b0d2-d0ce33ddae55 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.235461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.237598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.238395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.238672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.238983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.246272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.246797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.247189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.247468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.247789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/ff0e8e8eafa44aa294538c43527190d8/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.248263 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:23.268261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:23.269439 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 298/588] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:23.270346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.278075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=ff0e8e8eafa44aa294538c43527190d8, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.279738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.295126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 291/589] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:23 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/ff0e8e8eafa44aa294538c43527190d8/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:23.296434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.347322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.414307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f6bb0-645f-4a20-a2aa-701c8ba47c22 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.447789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76efab-8672-4207-bb56-e61106fb3543 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.471987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.473799 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.475185 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.475686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.488832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.489644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.490498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.490863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.492046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.494045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.501514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.503100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:23.519205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:23.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:23.521446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:23.521446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:23.521446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:23.521446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:23.521675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:23.522624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:10:23.523597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:23.524112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 299/590] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:23.524112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.524242 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 292/591] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:23.526715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.564440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.636345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620994-e8a9-47e4-953b-6a40898aae69 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.648697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a51bcb-cd00-45c9-8b8e-436591ed4318 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.666937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.673416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.674083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.674362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.674632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.675386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:23.675689 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.677050 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.687101 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.687774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.688054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.688333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.689176 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:23.689687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 293/592] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:23.689789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.690514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.691120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93803e-9bca-48e8-8308-d473ab160a96 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.710534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 300/593] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:23.716178 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06b24-0564-49c7-8fc7-de1bcc9c133a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.716473 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06b24-0564-49c7-8fc7-de1bcc9c133a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.716753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06b24-0564-49c7-8fc7-de1bcc9c133a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.718149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 301/594] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:23.718723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd06b24-0564-49c7-8fc7-de1bcc9c133a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.799387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.806925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236d231-c785-45ae-a640-9291f8bab1cd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.825330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd06b24-0564-49c7-8fc7-de1bcc9c133a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:23.849150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.850371 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.850651 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.850965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.851809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:23.852114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.853561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.871819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 294/595] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:23.872621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:23.878442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:23.879266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.879548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.879819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.887935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:23.889317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-638ccfa5-528e-4dc9-aa59-f3fd2f469286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:23.905937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:23.906933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:23.907819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 302/596] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:23.908928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:23.908928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:23.908928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:23.925800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:23.927025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:23.956728 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:23.986552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4db08-f353-451d-a751-75e05bf2a28f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.014833 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 303/597] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:24.014833 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.036107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.037474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.037757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.038033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.048559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.050001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:24.067590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:24.069065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:24.070680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:24.070680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:24.070680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:24.070680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:24.070680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 295/598] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:24.070680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.081702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.127613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c008-3ded-414f-83d0-d3cf7b5a8781 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.183789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.184582 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.184859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.185130 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.194320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0987b-a590-4d14-b766-d4038fc943e7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.196040 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.198261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:24.220657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:24.222123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:24.223443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:24.223443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:24.223443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:24.223443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:24.223443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 304/599] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:24.223443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.235396 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.236057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.236336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.236630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.237391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:24.237697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.239141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.241884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.251536 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 296/600] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:24.257435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.323009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.336259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307a04-c833-4700-a2c6-7768d1e2c7cd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.358692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b414-7c47-42d2-8880-b4b034765863 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.370810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.371647 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.371928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.372196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.382372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:24.390228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:24.391182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:24.392027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 305/601] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:24.398104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.402198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.402911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.403469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.404234 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:24.404542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.405924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.422557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 297/602] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:24.422557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.492508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.518697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c06ab0-0426-4e7b-9be2-bf9b6880e8f1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.526262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2a9b2-5f95-452a-a05e-485ae8d38385 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.553594 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.555552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.556225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.556503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.556778 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.557504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:24.557806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.559181 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.563868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.564973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.565417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.565837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/d3795d052ce442e9b20dc5f5ed810d37/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.572479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 306/603] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:24.573395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.584496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=d3795d052ce442e9b20dc5f5ed810d37, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.585958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.598689 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 298/604] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:24 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/d3795d052ce442e9b20dc5f5ed810d37/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:24.608493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.699717 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a55c19-2b94-402e-842e-37df4b66cc01 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.732516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217dabf-5b79-4715-ad1e-b0657e4225c2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.739493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.740230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.740515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.740787 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.741612 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:24.741924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.743638 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.746348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.759265 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 307/605] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:24.760464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.776753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.779134 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.779644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.780162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.788541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.791503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:24.805777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:24.806704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:24.807608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:24.811313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 299/606] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:24.811313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.857290 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:24.871215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d5771-7003-4632-a158-75fd8d1935ec None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.907804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.909098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.909466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.909828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:24.919823 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:24.921678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:24.936347 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12867ade-8adb-45c9-a71b-54fc18780cd2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:24.940804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:24.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:24.942557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:24.948731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 308/607] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:24.948731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:24.987987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:24.988811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:24.989095 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:24.989372 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.004162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.005891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.027220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:25.028908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:25.029765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:25.030631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:25.030631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:25.030631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:25.030631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:25.034897 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 300/608] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:25.035782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.073019 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd40bb-3238-419e-80c2-b5b7a876d07d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.108696 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.109752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.110277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.110753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.111940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:25.112554 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.114255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.127755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 309/609] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:25.128904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.131221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:25.144550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f68ce-20ef-49b2-af70-f45d74f0a662 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.182574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.183278 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.183558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.183827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.184612 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:25.184918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.186346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.203591 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 301/610] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:25.204480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.237025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca7a7-290d-402d-a1d9-a8fd9bd95193 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.261967 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:25.275423 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.276457 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.277007 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.277585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.278509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:25.279040 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.282138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.299818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 310/611] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:25.300801 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.308400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635cda-bf73-48e2-8a48-5c719ab76ee1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.343246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.344159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.344436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.344704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/157ade8895fa46d3b76023831c24a4a0/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.360976 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=157ade8895fa46d3b76023831c24a4a0, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.362513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.376980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:25.385501 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 302/612] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:25 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/157ade8895fa46d3b76023831c24a4a0/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:25.387417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.457787 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eaa06-8677-410a-a6c0-f2204fb0a25c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.514312 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dfe24-8517-4799-b4b6-eb5e0facc6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.515338 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dfe24-8517-4799-b4b6-eb5e0facc6ba None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.515715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dfe24-8517-4799-b4b6-eb5e0facc6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.516324 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dfe24-8517-4799-b4b6-eb5e0facc6ba None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/942d20017757425787011a2b41dbb5f3/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.547720 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dfe24-8517-4799-b4b6-eb5e0facc6ba None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=942d20017757425787011a2b41dbb5f3, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.550430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dfe24-8517-4799-b4b6-eb5e0facc6ba None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.576541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 311/613] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:25 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/942d20017757425787011a2b41dbb5f3/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:25.578033 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c96cf-a4cc-4e04-b464-c9977b991fd1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.578329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c96cf-a4cc-4e04-b464-c9977b991fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.578604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c96cf-a4cc-4e04-b464-c9977b991fd1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.585102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 312/614] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:25.586727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.587131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.587478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.608998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:25.610315 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:25.624236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4eda4-7f2e-4e7a-949c-00e064729c65 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.651298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:25.667765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.668850 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.669315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.669592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.678444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.679957 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:25.696360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:25.697387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:25.698298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 303/615] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:25.700315 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 313/616] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:25.703931 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.724090 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.776351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:25.859048 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6565a-eaf4-49c5-9e4b-3006ea107813 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.878945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24bde-c5a8-42e3-8b13-dbdcccc56f20 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:25.898855 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.899873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.900300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.900895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.902185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:25.902640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:25.904256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:25.922883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:25.924193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:25.924350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:25.924727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:25.929347 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 304/617] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:25.935607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:25.937987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:25.947003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:25.948133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:25.949149 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:25.951388 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 314/618] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:25.957405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.013593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.049306 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66d58e-0d32-4f21-866e-86dd97e6b700 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.075201 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.119782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.120603 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.120882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.121155 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.139448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfbb06-5263-4352-bbe9-11aed36a370b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.151679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.153163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:26.174436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:26.175407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:26.176298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:26.176298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:26.176298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:26.176298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:26.179057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 305/619] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:26.187920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.198838 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.199835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.200126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.200406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.201429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:26.201557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.202998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.218421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 315/620] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:26.223550 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.305064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a07a-749f-41cf-af2d-0c875a21c8e7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.347503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.348183 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.348470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.348743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.350034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:26.350340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.352213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.354215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.375531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 306/621] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:26.381541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.395784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7bdbf-0e88-4a04-9099-ad1e0f905167 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.439163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.449026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.449824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.450100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.450370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.461212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.462660 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:26.480834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:26.481771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:26.482657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:26.482657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:26.482657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:26.482657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:26.486515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 316/622] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:26.487701 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.547605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658640e-7629-46a2-ba6e-2f202a32bdfc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.601358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1bf4b-114d-4523-9721-57fceabe640b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.632473 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.637804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.638464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.638739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.639037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.639757 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:26.640057 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.641426 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.658782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 317/623] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:26.660106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.663496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.664317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.664596 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.664868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.699662 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.701128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:26.735531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:26.736508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:26.737407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 307/624] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:26.755822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.765580 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71551-a6a0-4cf2-a4d3-e5c8353b8734 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:26.800961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:26.801753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:26.802030 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:26.802337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:26.812321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:26.813772 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:26.841020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:26.842023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:26.842980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:26.848817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 318/625] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:26.852020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:26.939198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.959186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:26.963431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc3a9-f2c9-49e2-8dc7-63fa24f6fff1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.015562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.018368 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.019718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.020201 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.021751 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:27.023061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:27.024873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:27.049968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 308/626] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:27.052961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3512-a926-4d96-838c-a09ff32734a8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.055559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:27.120862 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.121519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.121808 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.122088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.122988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:27.123298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:27.124813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:27.153435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 319/627] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:10:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:27.158886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:27.217084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd981fe-0cfd-4e79-9314-2bbc2b6d56db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.261899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d62611-62cf-43db-a964-f5e29b61ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.263103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d62611-62cf-43db-a964-f5e29b61ab11 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.263415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d62611-62cf-43db-a964-f5e29b61ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.263903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d62611-62cf-43db-a964-f5e29b61ab11 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/2d851c6ec2514bdd8660b352254a7965/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.280938 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064bdf-b883-4260-a63e-95f4fd9c91e3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.282966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d62611-62cf-43db-a964-f5e29b61ab11 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=2d851c6ec2514bdd8660b352254a7965, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:27.285288 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d62611-62cf-43db-a964-f5e29b61ab11 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:27.295069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:27.295229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:27.306313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 309/628] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:27 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/2d851c6ec2514bdd8660b352254a7965/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:27.307781 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79af08-10a2-4c4e-b3f5-0a42cf0c0bb7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.308174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79af08-10a2-4c4e-b3f5-0a42cf0c0bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.308551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79af08-10a2-4c4e-b3f5-0a42cf0c0bb7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.310181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 310/629] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:27.335894 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.336331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.336893 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.338500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.339232 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.339603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.339877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.368058 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:27.369289 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:27.428708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:27.430184 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:27.497528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 311/630] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:27.534963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:27.575947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 320/631] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:27.577316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:27.590287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:27.688779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b053a9-19a6-45f4-8367-87aa1f31eaaf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.706949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b7bb-f516-4bbb-aa9b-5c3dccb7ff7e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.726499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.727371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.727664 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.727931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.739197 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:27.740564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:27.746437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:27.760867 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:27.761399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:27.762243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:27.763153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:27.763153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:27.763153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:27.763153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:27.764471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.764965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.765451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.771314 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 321/632] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:27.771314 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:27.784716 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:27.794546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:27.795537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:27.796358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:27.805121 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 312/633] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:27.824300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:27.843968 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:27.881135 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfb8fc-94d8-4ab3-8058-41153ebe23ad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:27.919038 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:27.919807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:27.920088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:27.920364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:27.921082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:27.921380 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:27.922754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:27.939546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 322/634] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:27.940843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.051643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed14627-2ddc-4766-be6b-7e23441149d0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.126509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaddc97-e1de-4707-bbae-616e55630065 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.131200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.131859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.132139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.132410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.133169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:28.133471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.139212 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.152634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 313/635] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:28.160536 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.183151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:28.202435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.203181 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.203456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.203721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.215279 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.216913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:28.233714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:28.234623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:28.235521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:28.239338 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 323/636] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:28.241843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.254664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:28.307437 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506904-7b9b-4ac9-aca6-648e026a6aff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.343103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.343897 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.344166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.344689 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.356141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.357607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.358424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571130-0383-4ab5-a38d-15146ba96037 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-27615a6e-042a-4b58-af3a-36e77b3ddf86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:28.375127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:28.376150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:28.377011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:28.377011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:28.377011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:28.377011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:28.377011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 314/637] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:28.377788 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aaae3-5eaf-494a-b258-089b9ba6ffb9 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.377860 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aaae3-5eaf-494a-b258-089b9ba6ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.378081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aaae3-5eaf-494a-b258-089b9ba6ffb9 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.379523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 315/638] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:28.382956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78675f0-7622-4608-93cb-9e1e19d1ee3d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.383508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78675f0-7622-4608-93cb-9e1e19d1ee3d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.383796 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78675f0-7622-4608-93cb-9e1e19d1ee3d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.385793 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 316/639] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:28.387568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78675f0-7622-4608-93cb-9e1e19d1ee3d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.408976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.409634 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.410059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.410324 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.411066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:28.411423 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.413343 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b15b7-0e10-4211-bb8e-eecfd6ff8067 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.425067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 324/640] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:28.425067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600bec-54f6-4825-96b3-3691d603dd45 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.425067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600bec-54f6-4825-96b3-3691d603dd45 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.425067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600bec-54f6-4825-96b3-3691d603dd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.445003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ab600bec-54f6-4825-96b3-3691d603dd45 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:28.446244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ab600bec-54f6-4825-96b3-3691d603dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:28.483557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:28.515232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78675f0-7622-4608-93cb-9e1e19d1ee3d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.516909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:28.526816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 325/641] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:28.526816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.526816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.526816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.546809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:28.548180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:28.563785 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.564455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.564737 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.565008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.565736 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:28.566043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.567462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.580228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 317/642] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:28.585711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.622814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 326/643] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:28.622814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.698033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2688ad-d0f8-41f1-879b-0ca0bada8204 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.729842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803360-6af7-48eb-b601-f2033d06e805 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.731599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:28.733121 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.733863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.734082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.734369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.735244 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=ff0e8e8eafa44aa294538c43527190d8) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:28.735555 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.737100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.745399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 318/644] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/role_assignments?user.id=ff0e8e8eafa44aa294538c43527190d8&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:28.746341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.782519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.783122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:28.784480 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.784915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.785347 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.798974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:28.807399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:28.808695 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:28.809769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:28.811274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 327/645] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:28.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.873870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c8f3-d403-4e62-88fd-ba323f107fdc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.912401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.913214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.913502 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.913780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:28.922520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:28.924063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:28.934166 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85edd2d-1866-44a1-a0b7-6fd68a30c85b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:28.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:28.941148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:10:28.942258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:28.946381 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 319/646] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:28.947234 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:28.986244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:28.987334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:28.987618 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:28.987896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.003493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:29.011408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:29.012322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:29.013154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 328/647] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:29.013819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.041882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.058633 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.081159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2f722-7d90-4f6a-94ad-6e821eedbced None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.123063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.123741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.124022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.125042 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:29.125348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.126716 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.137349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 320/648] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:29.138079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.138211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718ec53-3f8b-4721-85af-b89e1ec3089d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.179455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.180126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.180405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.180675 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.181611 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:29.181920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.183528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.203238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 329/649] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:29.207677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.277041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a422a-f5a5-4ab1-90c1-ee3edead6b19 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.312639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.325342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.326828 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.327256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.327698 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.329019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:29.329471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.331405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.334735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906447-7d6d-42ca-88df-4b2ea1035b4f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.342347 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 321/650] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:29.343451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.359699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.377188 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.378258 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.378500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.378934 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.390506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.391437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:29.415345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:29.416220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:29.417094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:29.417094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:29.417094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:29.417094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:29.421340 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 330/651] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:29.422238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.486463 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d87f-fdac-4a37-b0d6-5cc4fcdb9f95 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.524499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.525229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.526003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.526003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.545990 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3efce-91d9-4b11-ab52-93f102f47a5c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.577680 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.584923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.585896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.586211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.586579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.597663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.599904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.611177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.612873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:29.619081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:29.620165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:29.621241 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:29.621241 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:29.621241 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:29.621241 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:29.627202 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 331/652] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:29.628113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.629441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.742215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dfc97-6f0f-4101-b019-01b085a2f1da None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.750837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 322/653] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:29.750837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.784615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.785635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.786113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.787263 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.788286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:29.788884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.790465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.807976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 332/654] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:29.809182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.864191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc724e-1e7b-4345-9dbd-0ffb43373fc8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.865279 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.877623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:29.904863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.905529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.905813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.906084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.906823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:29.907131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.908522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.920738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 323/655] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:29.921520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:29.931785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7d53a-c79c-4a65-844d-b9549086c345 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:29.967171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:29.967949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:29.968222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:29.968486 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:29.980098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:29.981680 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-034aaf87-f7ed-493f-820e-a4b63253531a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:29.999004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:30.000071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 333/656] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320bca5-347c-4829-8dd4-55d027e7bf61 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320bca5-347c-4829-8dd4-55d027e7bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320bca5-347c-4829-8dd4-55d027e7bf61 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.005853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 334/657] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:30.006382 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320bca5-347c-4829-8dd4-55d027e7bf61 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.037923 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a120ed-83a7-411b-aaa6-30b10a724e68 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.074170 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.075248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.075520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.084736 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.086390 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:30.102665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:30.103865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:10:30.110813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:30.111492 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.111577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 324/658] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:30.111577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.120602 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320bca5-347c-4829-8dd4-55d027e7bf61 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.141399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.159329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.160494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.160780 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.161205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.168920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.170359 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d386f1ef-4766-4359-92ad-133e4295e69d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:30.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:30.185289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:30.186293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 335/659] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:30.186925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.187003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.187597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.204346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:30.205516 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:30.221443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0924dd-e4c2-4e7a-bc4b-9560909c31ce None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.255814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.256491 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.256772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.257045 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.257766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:30.258070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.259460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.276364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 325/660] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:30.276364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.285896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 336/661] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:30.286670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.377092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.391738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.395690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d112f-333d-41b5-a5f2-369d25cd1761 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.407130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c072fc3-fd46-4208-a24f-a2ed10dbce75 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.436679 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.437258 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.437562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.437990 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.438662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:30.438998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.440419 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.443080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.443769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.444045 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.444320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.445153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:30.445462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.446930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.459051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 337/662] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:30.464077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.469047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 326/663] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:30.469047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.569462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc078d-a396-4105-af98-31ff9085621c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.573496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1069eda-1e7b-4b48-b329-597a7ec73a68 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.605144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.606090 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.606447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.606811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.612200 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.612989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.613269 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.613541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.617430 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:30.620577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.622023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:30.625265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:30.626207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:30.627156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:30.631338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 327/664] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:30.631994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:30.636565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:30.637438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 338/665] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:30.643840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.644899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.650338 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.743796 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884dcd-89fd-4cb2-a7e5-a5b2bd913824 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.753134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca3e5-27de-4079-8c97-87a535dd2a0f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:30.779833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.780492 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.780775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.781049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.790414 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:30.791092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:30.791377 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:30.791654 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:30.853479 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.854973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.865441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.868455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:30.869899 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:30.873582 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:30.965475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 328/666] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:30.966440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:30.986569 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 339/667] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:30.987772 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.084461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b351448-c41f-4b54-8ca1-4679ec4b6675 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.096394 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.098264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c193-67f7-421f-bec0-c8691728b07a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.102474 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.125813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.126372 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.126656 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.126951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.127701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:31.128007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.129384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.137784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.138706 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.138835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 329/668] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:31.139356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.143332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.143637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.144456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:31.144772 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.146758 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.164094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 340/669] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:31.164094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.248354 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b7d8-39aa-45bd-ac73-8d8ad5b69463 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.261243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a957b68-8fbf-4bd6-be9f-aa2cd95daa1c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.281084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.281876 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.282159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.282431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.292721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.293926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.294160 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.294705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.295010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.295283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.306012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.307450 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:31.311235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:31.312118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:31.312988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:31.312988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:31.312988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:31.312988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:31.312988 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 330/670] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:31.313283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:31.325358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:31.326293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:31.327203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:31.327203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:31.327203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:31.327203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:31.327203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 341/671] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:31.327532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.344733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.346380 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.425860 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f821-733d-4dff-a692-50ac5560afd5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.427372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c3ba-ac37-4ebc-8f33-4475000b0a5b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.458595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.459426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.459708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.459953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.460094 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.460608 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.460894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.461141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.462049 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=d3795d052ce442e9b20dc5f5ed810d37) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:31.462361 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.464967 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81b65d-45b6-4c47-90cc-0d5d827d8a00 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.469994 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 342/672] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/role_assignments?user.id=d3795d052ce442e9b20dc5f5ed810d37&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:31.470957 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.471253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360949-efea-4c56-9b34-42139eb63a66 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.471538 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360949-efea-4c56-9b34-42139eb63a66 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.471813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360949-efea-4c56-9b34-42139eb63a66 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.472465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.473192 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 343/673] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:31.474276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360949-efea-4c56-9b34-42139eb63a66 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:31.500566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:31.501681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:31.503001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:31.503001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:31.503001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:31.503001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:31.503001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 331/674] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:31.507445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.577669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.599252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.605911 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360949-efea-4c56-9b34-42139eb63a66 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.630873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a77e6-0444-480c-8e2e-97dc040b7848 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.643312 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.644007 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.644291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.644562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.645291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:31.646168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.647655 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888cd11-772a-4dae-9af6-362d6a0fe8f9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.662909 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 344/675] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:31.667288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.667602 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.667890 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.674691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.674691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.674956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.675224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.675960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:31.676257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.677743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.684794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:31.686009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:31.691057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 332/676] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:31.691899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.758156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 345/677] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:31.758995 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.812811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c6d6d-6853-4461-9d18-7b44bb5d15d3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.831685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.850000 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.850668 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.850979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.851256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.852005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:31.852364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.853756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.855409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:31.872076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 333/678] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:31.872076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.872314 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7f6a-c8ef-45e4-ab9a-91d031be5ff5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:31.907265 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:31.908066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:31.908346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:31.908617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:31.915953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:31.917401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:31.931528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:31.932402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:31.933276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 346/679] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:31.933761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:31.984778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd38b-323a-43c3-99d0-3b55338b0183 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.040362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.040362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.040362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.040362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.046019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.047606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.062248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed430-b85a-428a-a359-3c6a0907cba9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:32.063352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:32.064200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:32.065084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:32.069379 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 334/680] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:32.070224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.095824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.102174 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.102996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.103280 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.103547 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.114595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:32.122754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:32.123708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:32.124542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 347/681] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:32.125685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.135225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.183883 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884925c-da3c-48e0-a64b-5f2c5509c49b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.220140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.220965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.221223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.221494 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.229463 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.231465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.240721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2563-af34-4692-a6e8-6292464755eb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:32.247262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:32.248220 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:32.249181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:32.253186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 335/682] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:32.253880 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.279086 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.279743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.280027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.280336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.281080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:32.281390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.282933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.295760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 348/683] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:32.296350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.366036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.368497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b54b3-c8c7-4b55-951f-b657b10d9057 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.384946 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.415139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.415917 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.416199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.416471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.417250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:32.417558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.419242 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.421366 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b35a-74a8-440d-ae39-bc783dba808d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.432551 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 336/684] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:32.438266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.455986 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.456809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.457089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.457649 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.458424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:32.458727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.460530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.474570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 349/685] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:32.474570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.544223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80814a-c17a-424a-bf07-1dd8e042009a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.575201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cabaf-1156-4990-85be-bdcad9e6a683 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.580436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.581106 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.581388 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.581783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.582620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:32.583088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.584678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.588022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.603496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 337/686] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:32.604320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.625249 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.625907 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.626191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.626467 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.627454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=157ade8895fa46d3b76023831c24a4a0) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:32.627769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.629302 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.646836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 350/687] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/role_assignments?user.id=157ade8895fa46d3b76023831c24a4a0&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:32.646836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.651186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.736903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b669a6-d441-49cf-aca6-94f7163ff406 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.776802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59aba-2665-4d40-a660-5c3d499eb1da None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:32.778407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.779348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.779700 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.780078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.781003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=942d20017757425787011a2b41dbb5f3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:32.781387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.782958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.791188 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 338/688] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/role_assignments?user.id=942d20017757425787011a2b41dbb5f3&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:32.792378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.815546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:32.816454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:32.816735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:32.817006 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:32.829294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:32.830957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:32.852264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:32.853270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:32.854548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:32.854548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:32.854548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:32.854548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:32.854548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 351/689] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:32.863235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:32.903209 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:32.999109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaec332-25b2-4f3d-97f2-96a75c3a4fa9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.041406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.042509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.043886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.044367 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.045316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:33.045819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.047518 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:33.061978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 352/690] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:33.068357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:33.081488 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:33.089694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b35b02-f959-4b27-807e-2124ded0b91c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.144869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.146138 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.146573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.146966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.182763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:33.197233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee6322-eb92-4d8e-9e21-08c80167889d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.236771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.237561 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.237844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.238109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.243020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.244502 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:33.245852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.247419 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:33.263743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:33.265292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 353/691] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:10:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:33.269571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:33.419017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:33.434000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e827c7-871c-48cd-8a71-13317a27da4d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.435108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 339/692] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:33.436132 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:33.471758 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.472437 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.472718 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.472992 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.473870 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:33.474177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.475637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:33.495357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 354/693] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:10:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:33.504459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:33.521544 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:33.624748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a2400-3137-4fc9-b310-57f556826850 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.662155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b866b-4707-4092-9e12-8333c478a53a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.705334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f696b5-ece5-4fe2-87ea-e452ed3ba805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.706031 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f696b5-ece5-4fe2-87ea-e452ed3ba805 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.706317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f696b5-ece5-4fe2-87ea-e452ed3ba805 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.706590 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f696b5-ece5-4fe2-87ea-e452ed3ba805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.711451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.712297 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.712573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.712842 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.737924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.739959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:33.779252 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:33.780221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:33.781092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:33.781092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:33.781092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:33.781092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:33.786744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 340/694] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:33.792371 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:33.854781 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f696b5-ece5-4fe2-87ea-e452ed3ba805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.855961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:33.856259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f696b5-ece5-4fe2-87ea-e452ed3ba805 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:33.865738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:33.933039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e78f1-9ecf-4091-ae57-fdd407da983b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:33.967029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 355/695] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:10:33.968752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6ab93-cc81-4ee0-b774-c27f71a47c64 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.969184 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6ab93-cc81-4ee0-b774-c27f71a47c64 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.969630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6ab93-cc81-4ee0-b774-c27f71a47c64 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.975482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 356/696] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:33.976410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6ab93-cc81-4ee0-b774-c27f71a47c64 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:33.984432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:33.985102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:33.985897 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:33.986227 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:33.987006 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:33.987340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:33.989206 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a53d6-b06e-4ac3-aecc-efeff97eb774 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.010016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 341/697] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:34.010016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.010016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.010016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.029844 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:34.031410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:34.091893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6ab93-cc81-4ee0-b774-c27f71a47c64 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.100237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:34.122818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 342/698] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:34.122818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.142003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.143454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.143930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.144376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.164067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.164235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:34.165955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:34.185803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:34.186670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:34.187588 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:34.187588 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:34.187588 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:34.187588 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:34.189739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 357/699] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:34.190742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.250211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c95c8-520a-4374-a7e8-1b67b8e3da3e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.294508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.295697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.299141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.299141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.305611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.307753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.317016 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6b9c-0a42-40ac-b5ff-fca786bda194 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:34.326070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:34.326993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:34.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 343/700] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:34.328942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.357729 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.359124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.359616 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.360082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.360943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.362816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:34.379668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:34.381251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:34.382156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:34.385245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 358/701] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:34.386375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.423391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:34.450568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:34.457292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be51a7-db77-4a7c-8e46-4e0611593570 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.495040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.495695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.495974 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.496248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.496971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:34.497273 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.498630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.515707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 344/702] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:34.515707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.528785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8b8d2-00b7-4996-b295-d417c127d9d7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.563092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.563750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.564027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.564300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.565083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:34.565388 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.566967 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.580814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 359/703] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:34.581766 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.654181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54785-0a30-47f8-aa68-4191f338645f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.669785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:34.691322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c92e-46cb-4e24-81dd-3cd2912eff2d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.704383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.705281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.705994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.706443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.707610 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:34.707978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.709346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.715500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 345/704] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:34.717133 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.731921 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.732713 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.732989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.733357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.741047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.742686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.749787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:34.758039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:34.758957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:34.759925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:34.762915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 360/705] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:34.764010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.849767 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0178f-15c2-4ef0-bee3-860ae1550bb6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.878932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30d1a-f61d-4119-8fdb-04cfab79f67e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:34.897794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.898861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.899344 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.899825 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.901400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=2d851c6ec2514bdd8660b352254a7965) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:34.902160 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.904439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.914003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 346/706] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/role_assignments?user.id=2d851c6ec2514bdd8660b352254a7965&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:34.915071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:34.916214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:34.916958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:34.917308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:34.917648 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:34.918443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:34.918852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:34.920938 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:34.933280 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 361/707] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:35.032064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:35.050840 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ab9d7-8a9a-4cc8-b6fe-0177eabca5a3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:35.090744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:35.091810 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.092281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.092729 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.093715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:35.094205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:35.095944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe8282-7f7a-454a-b5d0-a1ce89e2a0a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:35.112051 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 347/708] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:35.118293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:35.139928 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:35.261506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ead98c-2d75-4e5f-852c-6d07d32b141a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:35.303404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:35.304046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.304330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.304599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.305440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=ff0e8e8eafa44aa294538c43527190d8) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:35.305746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:35.309212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c90e5-d6a2-42e0-9d5a-fc0aa0fc32b6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:35.317865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 362/709] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:35 2022] GET /identity/v3/role_assignments?user.id=ff0e8e8eafa44aa294538c43527190d8&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:35.476732 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959968e2-a16e-4d6b-b7b3-330eaf01d421 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.477280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959968e2-a16e-4d6b-b7b3-330eaf01d421 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.477280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959968e2-a16e-4d6b-b7b3-330eaf01d421 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.479089 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 348/710] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:35.485214 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9f71-b507-4097-9855-5186b81419fa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.485519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9f71-b507-4097-9855-5186b81419fa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.485781 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9f71-b507-4097-9855-5186b81419fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.514843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-34ea9f71-b507-4097-9855-5186b81419fa None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:35.516077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-34ea9f71-b507-4097-9855-5186b81419fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:35.599734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:35.606802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 363/711] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:35.614420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80d71-8380-4f29-92f4-48dc8d9f18e7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.614720 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80d71-8380-4f29-92f4-48dc8d9f18e7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.615019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80d71-8380-4f29-92f4-48dc8d9f18e7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.616748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 349/712] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:35.622552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.622874 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.623155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.647836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:35.648155 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be80d71-8380-4f29-92f4-48dc8d9f18e7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:35.649047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:35.779961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 364/713] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:35.845078 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:35.860918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be80d71-8380-4f29-92f4-48dc8d9f18e7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:35.932092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:35.932906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:35.933187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:35.933456 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:35.949237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:35.950707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:35.974817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:35.985203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc49d-7144-4aff-8e4c-b2ed8ba2378e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:35.993783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:35.994697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:35.995708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:35.995708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:35.995708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:35.995708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:36.007439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 350/714] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:36.013123 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:36.028061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:36.038218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:36.039052 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:36.040121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:36.040616 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:36.041291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:36.042662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:36.068651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:36.072032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:36.073979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 365/715] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:35 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:36.079908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:36.225336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788bfd-cb80-4778-8a21-be8b66b453c3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:36.274331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:36.274699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29cd41-3be6-43c4-bf54-e2886fcf0ac3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:36.275031 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:36.275313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:36.275590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:36.276327 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:36.276635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:36.278007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:36.290231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 351/716] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:36.299783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:36.315328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:36.316754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:36.317788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:36.318242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:36.319169 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] RBAC: Adding query filter params (name=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:36.319714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:36.321330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:36.327677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 366/717] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:10:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:36.332606 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:36.419216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:36.448339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:36.465739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e56f7-c1ec-47eb-8865-2459856aef66 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:36.527578 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6611-c595-4eb7-b951-2c31c205ea36 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:36.529597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:36.530262 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:36.530536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:36.530815 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:36.531541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] RBAC: Adding query filter params (type=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:36.531845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:36.533211 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3ccb5-7538-4e0b-98d1-2698e8485b13 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:36.546714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 367/718] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:10:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:36.581596 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a9f8-6387-41b2-a2da-429bd978d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:36.582284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a9f8-6387-41b2-a2da-429bd978d18d None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:36.582564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a9f8-6387-41b2-a2da-429bd978d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:36.582910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a9f8-6387-41b2-a2da-429bd978d18d None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:36.583620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a9f8-6387-41b2-a2da-429bd978d18d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:36.585048 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a9f8-6387-41b2-a2da-429bd978d18d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:36.622771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 352/719] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:10:36 2022] POST /identity/v3/users => generated 254 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:37.703663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab2a8-360e-4df4-b39e-2e175931925f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:37.704686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab2a8-360e-4df4-b39e-2e175931925f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:37.705172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab2a8-360e-4df4-b39e-2e175931925f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:37.707041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 368/720] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:37.712508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4064-9745-4eba-bbdf-427e749a8a2e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:37.713429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4064-9745-4eba-bbdf-427e749a8a2e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:37.713903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4064-9745-4eba-bbdf-427e749a8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:37.740410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-281d4064-9745-4eba-bbdf-427e749a8a2e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:37.741631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-281d4064-9745-4eba-bbdf-427e749a8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:37.843571 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 353/721] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:37.867293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab2a8-360e-4df4-b39e-2e175931925f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:37.897607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5f40-75ae-4fec-9996-c2d3f7f84eed None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:37.897892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5f40-75ae-4fec-9996-c2d3f7f84eed None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:37.898337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5f40-75ae-4fec-9996-c2d3f7f84eed None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:37.900162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 354/722] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:10:37.904675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877896c-dcb6-4a0f-a1ef-a1170c7e6e66 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:37.905124 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877896c-dcb6-4a0f-a1ef-a1170c7e6e66 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:37.905539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877896c-dcb6-4a0f-a1ef-a1170c7e6e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:37.936526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7877896c-dcb6-4a0f-a1ef-a1170c7e6e66 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:37.940081 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7877896c-dcb6-4a0f-a1ef-a1170c7e6e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:38.003391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:38.023899 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab2a8-360e-4df4-b39e-2e175931925f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.034022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 355/723] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:38.035648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa405b-3a80-4f89-aa29-40278ce74bb2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.036725 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa405b-3a80-4f89-aa29-40278ce74bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.037181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa405b-3a80-4f89-aa29-40278ce74bb2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.043007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 356/724] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:38.044459 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.044920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.045370 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.049120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:38.061422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.062328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.062749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.063205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.064111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:38.065306 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:38.065782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:38.066864 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:38.090993 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 369/725] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:10:37 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:38.092423 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.197129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 357/726] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:38.211274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89328-6bcb-468a-a00a-d9fafa22434b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.231925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.248604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.249697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.250215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.250625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.262596 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:38.271783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:38.272924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:38.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:38.276514 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 370/727] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:38.281723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.351227 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:38.402356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69829f-a8fa-496d-b95d-2fd5228e69e7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.463404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.463772 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.464122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.465457 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:38.465842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:38.467343 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:38.480653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 371/728] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:38.481987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:38.485111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.485619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32e47-b393-413b-9026-dc1ac3143a16 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.536196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.537088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.538191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.538475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.551752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:38.561742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:38.562677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:38.563528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:38.564482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 358/729] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:38.570362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.615337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e9025-48d1-4e81-a965-ac470c3a42a2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.631244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:38.693004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068411-5148-4c69-a54f-7f946eb9dc6c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.730823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.731714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.732149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.732504 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.733339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:38.733720 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:38.735209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:38.745005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 359/730] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:38.750549 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.751049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.751393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.751677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.751949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:38.783117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:38.787714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:38.789123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:38.831641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:38.833127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:38.834469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:38.834469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:38.834469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:38.834469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:38.834469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 372/731] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:38.839915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:38.937076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dcaaa-67c3-4aae-a45e-58119416d27d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:38.986125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:38.987376 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:38.987869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:38.988343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.000030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.001744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:39.024082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:39.025024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:39.025920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:39.025920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:39.025920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:39.025920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:39.036431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 360/732] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:39.038914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.079773 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06b82-6535-45d8-af86-e226841bce35 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.136983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.137652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.138064 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.138348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.139258 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:39.139564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.141573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123610-d428-41d2-8764-84e8b1222585 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.163194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 373/733] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:39.163811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:39.164601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe690d6-c345-41c2-ba52-9182995955fc None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.164733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe690d6-c345-41c2-ba52-9182995955fc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.164965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe690d6-c345-41c2-ba52-9182995955fc None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.166384 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 374/734] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:39.167106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe690d6-c345-41c2-ba52-9182995955fc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.189705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:39.197631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21eced-de7f-4d51-8df9-81b4803002ed None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.235642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.236308 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.236588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.236858 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.237583 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:39.237887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.239323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc229-aa60-49f3-a9d9-1dba3abec96d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.254002 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 361/735] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:39.255868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.256148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.256420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.276950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:39.278296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:39.298180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe690d6-c345-41c2-ba52-9182995955fc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.342974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.344322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.344779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.345277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.355263 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.357360 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.366911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 362/736] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:10:39.368377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:39.385697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:39.386673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:39.387754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 375/737] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:10:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:39.390406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.463164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:39.493373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:39.511016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db182-2fbd-4654-91f1-e16150e7180f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.525732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ef2d8-144f-433f-b6d3-ea2905fbb938 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.553812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.554649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.554968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.555240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.563268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.564735 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.566080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.567748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.568306 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.568790 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.569744 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.571356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:39.580315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:39.581320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:39.582261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 363/738] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:39.583558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.599196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 376/739] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:10:39 2022] POST /identity/v3/services => generated 240 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:39.600750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.698632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d8b8e-cbad-4168-b7b8-c46b5b465ffa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.726226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:39.747721 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.748861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.749359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.749947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.751099 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:39.751768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.753559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519e6f0-22b2-4817-9c7e-f7dd79fd24fa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.788625 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 364/740] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:10:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:39.791017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0001e-e461-4617-a1f8-5b47d0e12c61 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.791502 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0001e-e461-4617-a1f8-5b47d0e12c61 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.791967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0001e-e461-4617-a1f8-5b47d0e12c61 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.799933 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 365/741] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:39.799933 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0001e-e461-4617-a1f8-5b47d0e12c61 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:39.824705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2287b-58ef-4c40-87cf-6b66d17c485e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.872372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.873050 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.873330 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.873600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.874449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:39.874756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:39.877724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a40ee-16f7-4a44-86e8-dfc6c95bbac6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:39.882810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:39.902978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 377/742] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:10:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:39.904955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.908034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.908034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:39.925925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:39.927711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:39.940671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0001e-e461-4617-a1f8-5b47d0e12c61 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:39.989905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:39.991108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:39.992195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:39.992697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.005791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 378/743] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:40.006720 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.007590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.009478 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:40.041714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:40.042695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:40.044279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:40.044279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:40.044279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:40.044279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:40.044279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 366/744] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:40.044279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.083169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.149365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf41050-4fff-4780-99a0-86c78bee3b3f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.160732 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03b9e-ade1-49c5-a717-4876a223c453 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.176734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.196082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.196921 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.197303 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.197729 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.204512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.205518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.205938 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.206346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.221269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:40.232358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:40.233486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:40.234489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:40.237467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 367/745] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:40.238495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.285432 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.287759 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.347086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.357537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b12c-33b2-4aa0-b890-cfb024881958 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.395628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.399923 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.400367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.400814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.404515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 379/746] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:10:40.404904 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:40.405377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.406598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.407609 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.425915 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 368/747] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:40.427402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.433723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.514454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4444-c6d0-4fbe-b4e1-3577c73e7c34 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.539204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963884b-4b69-484a-8032-7efd2d18926b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.556919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.557248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.557532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.557796 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.558620 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:40.558989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.560496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.574711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 380/748] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:40.575758 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.580869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.581846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.582270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.583274 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.594623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.596428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:40.615690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:40.616749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:40.617754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:40.617754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:40.617754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:40.617754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:40.619727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 369/749] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:40.620799 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.625312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.674586 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.692672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1bcf0-b164-4219-a1f4-7f6178d78144 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.728328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.729215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.729496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.729769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.731402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85087b6-6869-4adf-a9c2-22c42e9ed50b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.736492 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.737914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:40.752368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:40.753393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:40.754335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 381/750] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:40.754836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.775282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.776679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.776977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.777257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.788647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.790086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0ef79b95-7d93-490a-a74b-e0c1a6e91d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:40.807623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:40.808534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:40.809411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:40.809411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:40.809411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:40.809411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:40.809411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 370/751] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:40.810226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c65cc-fd2c-4360-a320-2912c79c8651 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.810327 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c65cc-fd2c-4360-a320-2912c79c8651 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.810538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c65cc-fd2c-4360-a320-2912c79c8651 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.816130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 371/752] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:40.816130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c65cc-fd2c-4360-a320-2912c79c8651 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.870842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc3fa-b185-43c9-9aa9-fde351e79647 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.872625 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.911031 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.911846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.912126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.912399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.913122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:40.913677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.914774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.923306 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c65cc-fd2c-4360-a320-2912c79c8651 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:40.927173 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 382/753] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:40.928152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:40.940713 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:40.964477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:40.965200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.965484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.965766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:40.966559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:40.966900 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:40.968329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dc02b-b667-4bc5-949d-74320f73ffef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:40.986370 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 372/754] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:40.987632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:40.987915 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:40.988185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.004788 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:41.005968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:41.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1dd27-f837-4c83-a718-bf30f2b464fc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.074339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 373/755] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:41.075218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.092592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.094382 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.094884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.095342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.096474 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:41.096863 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.099124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.115814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 383/756] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:41.116948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.137582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:41.188288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:41.197122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58e92-0c2c-4a6c-9048-75e73c90614b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.224181 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5050-c78a-4af2-8f7d-caf6d44d724f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.234410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.235538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.235823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.236095 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.242769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.244233 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.257771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.258642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.258950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.259221 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/ff0e8e8eafa44aa294538c43527190d8/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:41.259562 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:41.260413 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:41.266239 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:41.266709 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=ff0e8e8eafa44aa294538c43527190d8, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 374/757] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:41.267077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.267220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.286829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 384/758] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:41 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/ff0e8e8eafa44aa294538c43527190d8/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:41.286829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.412789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697d4c-4802-4d6d-9c42-f5ff7e2c61ea None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.422593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987191-3272-46db-81df-12496ae64bc1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.425550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:41.447759 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:41.462101 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.463356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.464006 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.464476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.475232 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.476971 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.483623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.485180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.485678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.486165 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.487086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.488874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:41.493933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:41.495194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:41.496154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 385/759] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:41.496728 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:41.511377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:41.512377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:41.513210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:41.516444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 375/760] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:41.517799 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.634108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab4a0-132c-4321-9880-733cd8fa82a9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.648842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a368e-dc8d-4c44-a028-dff5ebe236b5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.670685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.671353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.671658 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.671960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.672757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:41.673065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.674499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.694226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 376/761] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:41.695146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.696265 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.697156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.697918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.698406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.700385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:41.700915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.702531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.719471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 386/762] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:41.720863 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.723868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:41.781868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:41.821308 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f27b-5f3e-4ce9-86f0-65c6bb2d1fd2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.840222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9239d9-153e-40e7-9cf5-4570ff2c1646 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:41.874486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432029-e01e-4651-832d-64d042ea20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.875574 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432029-e01e-4651-832d-64d042ea20de None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.875855 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432029-e01e-4651-832d-64d042ea20de None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.876125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432029-e01e-4651-832d-64d042ea20de None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.876876 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432029-e01e-4651-832d-64d042ea20de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:41.877184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432029-e01e-4651-832d-64d042ea20de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.878576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432029-e01e-4651-832d-64d042ea20de None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.884350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 377/763] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:41.885285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432029-e01e-4651-832d-64d042ea20de None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:41.886233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8950e-f01c-4063-9410-2932365e1bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:41.887454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8950e-f01c-4063-9410-2932365e1bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:41.888175 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8950e-f01c-4063-9410-2932365e1bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:41.889860 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8950e-f01c-4063-9410-2932365e1bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:41.977084 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8950e-f01c-4063-9410-2932365e1bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:41.978556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8950e-f01c-4063-9410-2932365e1bd1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:41.991161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.004956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432029-e01e-4651-832d-64d042ea20de None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.029515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.051669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.052327 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.052605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.052873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.053701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=2d851c6ec2514bdd8660b352254a7965) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:42.054010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.055462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.061299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 378/764] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/role_assignments?user.id=2d851c6ec2514bdd8660b352254a7965&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:42.062846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.099535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 387/765] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:10:42.101342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157f6d-2ca1-4228-9a05-12f52dd19a48 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.101788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157f6d-2ca1-4228-9a05-12f52dd19a48 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.102218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157f6d-2ca1-4228-9a05-12f52dd19a48 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.104128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 388/766] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:42.109638 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.110144 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.110559 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.133810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:42.135782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:42.205827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8333b-d53f-4186-8d42-1c901c7849fc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.249351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.250299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.250727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.251182 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.252083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:42.252573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.254704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.262529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 379/767] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:42.263718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.286321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.358339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 389/768] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:42.359304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.418038 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55bb83-9158-47cf-bfa5-5a6ed5e0d91d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.453077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.468804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.469730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.469933 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.470157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.481750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.483270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.485145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6cdd6-94e5-400e-83ff-77e95af997e4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:42.501679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:42.502586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:42.503910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:42.503910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:42.503910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:42.503910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:42.507934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 380/769] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:42.508757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.535814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.537162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.537671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.538359 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.540138 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] RBAC: Adding query filter params (interface=public, service_id=b036efd3aea640759fec488bdb64083c, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:42.540630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.542940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.556263 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 390/770] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/endpoints?service_id=b036efd3aea640759fec488bdb64083c&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:42.557898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.587811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.627420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502b79-65b3-4c0f-88e6-421903db917c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.671915 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.672829 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.673679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.674063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] PATH_INFO: `/v3/services/network` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.675096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.677218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.686334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20eba-53a0-4843-9f8b-b7411cc25a31 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:42.692582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:42.693534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:42.694350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:42.695360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 381/771] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:42.696698 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.725094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.726268 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.726752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.727252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.728187 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:42.728687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.730328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.740026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.743843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 391/772] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:42.745098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.833335 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6febdcb-5cde-4a4e-91d4-a5191fb22e11 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.864567 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ed27-a799-4b97-8e7a-97be9dc917b6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:42.869376 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.870128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.870475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.870840 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.871599 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.873043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.874354 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:42.879973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 382/773] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:42.881157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:42.910191 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:42.911513 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:42.911882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:42.912229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:42.913027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] RBAC: Adding query filter params (name=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:42.913399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:42.914909 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:42.924925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 392/774] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:42.926177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:43.004156 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca46420-6394-46a4-83f6-7ffb16ae27cd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.015947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:43.054733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.056372 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.056944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.057402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.058583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4eb8-2168-45b2-9bba-3d78d0048679 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.067521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:43.069677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:43.090377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:43.091321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:43.092207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:43.094842 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 383/775] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:43.101193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.102014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.102417 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.102738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:43.102871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.103923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:43.104325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:43.105779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:43.116723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 393/776] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:10:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:43.123284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:43.209775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:43.255392 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9094fe-e1b4-4520-a67e-44154e539243 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.274836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4872-2a47-456c-92c7-f0bfc0841bc0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.293368 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.294374 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.294899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.295391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.296419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:43.296930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:43.298561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:43.303089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:43.311576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.312229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.312506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.312781 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.313604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] RBAC: Adding query filter params (interface=public, service_id=875fdf3e1e4649e48e3bc59808ca10c2, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:43.313815 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 384/777] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:43.313979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:43.316266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:43.320364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:43.328715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 394/778] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:10:43 2022] GET /identity/v3/endpoints?service_id=875fdf3e1e4649e48e3bc59808ca10c2&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:43.334106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:43.462892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0851a42-b1d4-4251-9247-c91554ec31fe None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.485199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:43.504833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.506029 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.506512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.507125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.508164 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=a9627879440241d6b90a3542fef29dab) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:43.508675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:43.510299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef267a5-ae45-49f1-a5a4-f5f29a2af58e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:43.518257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 385/779] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:43 2022] GET /identity/v3/role_assignments?user.id=a9627879440241d6b90a3542fef29dab&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:43.583843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf2da6-bbe4-401f-a8c2-7560e22d5529 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.634103 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e743aad-6135-47f6-b063-76f0d79bcd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.634804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743aad-6135-47f6-b063-76f0d79bcd08 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.635090 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743aad-6135-47f6-b063-76f0d79bcd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.635364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743aad-6135-47f6-b063-76f0d79bcd08 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.636063 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e743aad-6135-47f6-b063-76f0d79bcd08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:43.637441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e743aad-6135-47f6-b063-76f0d79bcd08 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:43.648924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 395/780] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:10:43 2022] GET /identity/v3/services => generated 772 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:43.667285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0031-7162-4e21-ab67-820ac203621a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.667896 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0031-7162-4e21-ab67-820ac203621a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.668427 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0031-7162-4e21-ab67-820ac203621a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.670374 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 386/781] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:43.676430 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.676742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.676983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:43.698301 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:43.699929 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:43.767514 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:43.793892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 396/782] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:43.834331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0031-7162-4e21-ab67-820ac203621a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:43.949981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0031-7162-4e21-ab67-820ac203621a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:43.987272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:43.988458 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:43.988949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:43.989425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.001321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:44.009567 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:44.010523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:44.011401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:44.014207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 387/783] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:44.022743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:44.130651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65eb88-274a-4ea1-b938-028db2338c55 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:44.167768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:44.168885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:44.169369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:44.169840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.170804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:44.171342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:44.172906 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:44.182275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 397/784] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:44.188027 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:44.267057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:44.359054 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724eea0-064d-4e51-afb8-de1114d8dd34 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:44.419509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:44.420326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:44.420602 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:44.420872 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.435873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:44.437339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2130685a-d988-479d-acb1-1a5894feb569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:44.455652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:44.456615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:44.458069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:44.458069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:44.458069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:44.458069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:44.458069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 388/785] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:44.464746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:44.478854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95545aff-7284-4f70-b541-dda61f12cd96 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:44.478854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95545aff-7284-4f70-b541-dda61f12cd96 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:44.478854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95545aff-7284-4f70-b541-dda61f12cd96 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.478854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 389/786] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:10:44.483941 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:44.484222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:44.484495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.520837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:44.522003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:44.529601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:44.602494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a072a-3414-433d-b6e3-03c1297f6fb1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:44.659164 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:44.660183 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:44.660722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:44.661198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.662195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:44.670833 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:44.670952 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 390/787] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:10:44.672607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:44.686838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:44.692908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 398/788] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:44.704157 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:44.755198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:44.794778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab2d00-3c96-4ff0-acdc-74e585d2bed8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:44.829131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:44.829920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:44.830202 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:44.830473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:44.842015 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:44.850901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:44.851836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:44.852690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:44.857860 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 391/789] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:44.859102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:44.969824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:44.987884 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36146-a714-40ce-a842-7c7d0e9a7620 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:44.990401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a100317-eda3-4db2-ac4a-dc5c370c9511 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.011182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:45.028548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.029230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.029509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.029781 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.030530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:45.030854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.032694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.047038 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 392/790] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:45.048809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:45.076195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.077094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.077383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.077658 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.096037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.097497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:45.126683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:45.127689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:45.128601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 399/791] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:10:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:45.140143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:45.161841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c485-265d-4fde-bd70-53450cc96d22 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.198034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.198861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.199280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.199556 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.211094 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.212837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:45.231144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:45.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:45.235441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:45.235441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:45.235441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:45.235441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:45.235441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:45.238749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 393/792] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:45.239061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:45.338782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44150-0d2e-4c0c-8e9f-d2d3ea6b6fde None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.378031 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.378699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.379028 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.379305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.380143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:45.380447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.381854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.424957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 400/793] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:10:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:45.431537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0598-d7b1-4337-b466-aa361951ad9d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.433591 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:45.519512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.520719 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.521005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.521284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:45.522020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:45.522328 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.523788 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.561284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 394/794] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:45.576064 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d478d-8ff3-4ffe-9725-50815f33e76e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.576261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:45.612788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cccea-8849-4b15-ae9c-8054ab39fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.613416 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cccea-8849-4b15-ae9c-8054ab39fe24 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.613710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cccea-8849-4b15-ae9c-8054ab39fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.613988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cccea-8849-4b15-ae9c-8054ab39fe24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.684666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cccea-8849-4b15-ae9c-8054ab39fe24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.686106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cccea-8849-4b15-ae9c-8054ab39fe24 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.723706 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:45.763226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:45.801594 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 401/795] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:10:45.803111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd859408-3107-4ee4-92ac-786aafae5c9d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.803396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd859408-3107-4ee4-92ac-786aafae5c9d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.803663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd859408-3107-4ee4-92ac-786aafae5c9d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.805199 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 402/796] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:45.806517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd859408-3107-4ee4-92ac-786aafae5c9d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:45.824440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58578e-6aa5-4d9a-952f-81bc4c2621de None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.871841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.873077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.873411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.873958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.884738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.886448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2da5e192-cd48-40bf-b8f5-a643989dbc75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:45.905939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:45.906947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:45.907863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:45.908383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 395/797] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:45.911737 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016fca3-557e-4738-868c-d639626241d0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.911737 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016fca3-557e-4738-868c-d639626241d0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.911737 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016fca3-557e-4738-868c-d639626241d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.931468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1016fca3-557e-4738-868c-d639626241d0 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:45.931694 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd859408-3107-4ee4-92ac-786aafae5c9d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:45.933299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1016fca3-557e-4738-868c-d639626241d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:45.961782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:45.971477 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:45.972598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:45.972984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:45.973283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:45.986042 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:45.988342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:46.011151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:46.012264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:46.013215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:46.013215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:46.013215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:46.013215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:46.017041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 403/798] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:46.017893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.028890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 396/799] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:46.029837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016fca3-557e-4738-868c-d639626241d0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.082995 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.147664 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13adb-d114-4a19-a75a-3dbee8b747c5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.154762 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016fca3-557e-4738-868c-d639626241d0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.184243 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.184848 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.185126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.185387 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.186217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:46.186516 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.188182 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.206120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.207230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.207712 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.208175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.209097 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:46.209596 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.211270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.211676 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 404/800] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:46.212560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.227204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 397/801] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:46.228365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.257134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.332723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74459-6f06-4b8e-9d23-e936f5899931 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.350972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc767b-3a54-4579-a17d-6fe37996657a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.360451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.372143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.372947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.373229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.373487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.374141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.375522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:46.387333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:46.388277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:46.389110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 405/802] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:46.389925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.394350 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.395980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.396435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.397102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.411613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.414000 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ca3b9a4e-ce20-4887-873d-2011eca14a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:46.431911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:46.432806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:46.433692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:46.433692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:46.433692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:46.433692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:46.434939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 398/803] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:46.436340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbd74a-1e5d-4b79-94ec-d2b9baaaca5e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.436628 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbd74a-1e5d-4b79-94ec-d2b9baaaca5e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.436903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbd74a-1e5d-4b79-94ec-d2b9baaaca5e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.438174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 399/804] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:46.438882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbd74a-1e5d-4b79-94ec-d2b9baaaca5e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.505387 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.508836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9ebc4-7f37-4455-8060-b5295da27240 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.542107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbd74a-1e5d-4b79-94ec-d2b9baaaca5e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.543048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.543839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.544125 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.544403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.551410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.552931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:46.567500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:46.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:46.569332 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 406/805] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:46.569801 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.578895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.579557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.579835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.580105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.580816 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:46.581120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.583092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83955-d9cc-4f46-b888-1cb57ee2b5b2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.587796 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 400/806] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:46.588972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9aaa7-c703-4530-979e-83d8126d9877 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.589254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9aaa7-c703-4530-979e-83d8126d9877 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.589523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9aaa7-c703-4530-979e-83d8126d9877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.605908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3af9aaa7-c703-4530-979e-83d8126d9877 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:46.607109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3af9aaa7-c703-4530-979e-83d8126d9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:46.624088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.667218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7a5e2-ab64-4bdf-9387-c2e548c5f066 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.672879 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 401/807] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:46.674247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece9925-0137-4dd4-a022-11cb34e4554c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.674542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece9925-0137-4dd4-a022-11cb34e4554c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.674845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece9925-0137-4dd4-a022-11cb34e4554c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.676116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 402/808] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:46.676818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece9925-0137-4dd4-a022-11cb34e4554c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.705546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.706220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.706499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.706769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.708088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:46.708387 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.709733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.721004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 407/809] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:46.721970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.742762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.778332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece9925-0137-4dd4-a022-11cb34e4554c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.811396 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.812047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.812325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.812599 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.813383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:46.813679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.815129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc764e-fac8-4523-b183-7089375e3f9e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.819779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517703-8509-4c7a-bcc0-c74b69595c3c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.827394 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 403/810] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:46.828606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.828892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.829165 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.845316 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:46.846498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:46.853454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.854109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.854384 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.854656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:46.855402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:46.855711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:46.855848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.857049 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:46.861923 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 408/811] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:46.862534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.917553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 404/812] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:46.918309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:46.947802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:46.964103 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8992a8-9867-4b3e-9404-ed10b941dcff None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:46.998041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:46.998845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:46.999129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:46.999403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.009474 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:47.017436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:47.018371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:47.019254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 409/813] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:47.020450 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.030745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a59bf-203a-49b7-8297-435f756e6f04 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.064427 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.065210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.065487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.065754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.072324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.073754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:47.087616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:47.088631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:47.089526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 405/814] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:47.090008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.096966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:47.118357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94aee-2fd3-4068-a457-6177d2c7e95d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.152651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.153285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.153558 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.153828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.154652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=ff0e8e8eafa44aa294538c43527190d8) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:47.154981 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.156383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.163043 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 410/815] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/role_assignments?user.id=ff0e8e8eafa44aa294538c43527190d8&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:47.163935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.175926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:47.197248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac3034-3c3b-4b85-97d5-e552b9dd0e01 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.237237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.237910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.238229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.238508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.239320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.240743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.263026 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 406/816] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:10:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:47.263918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.292159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a97ee-39cd-47a4-9a95-2a35c23e24c8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.345478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.346821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.347286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.347765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.348594 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.350218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:47.372494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:47.373733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:47.374753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 411/817] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:47.379691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.388211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:47.454088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8099e-1546-4786-8a1f-40f30a6c897c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.471802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:47.497895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.499043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.499509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.499962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.500981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:47.501473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.503249 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.508271 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a405b-76fb-47a3-89e3-8eef26d954f2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.513857 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 407/818] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:47.514930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.551316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.551979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.558754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.559362 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.561237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:47.561748 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.563443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.580710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 412/819] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:47.581842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.652271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d24f-df1d-4360-bd33-96c82ec7de30 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.696586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.697783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.698144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.698497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.699337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] RBAC: Adding query filter params (name=network) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:47.699814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.701804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.703135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:47.709294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 408/820] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:47.712319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.723555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309c30-d617-4eb7-9a38-4c2e54557901 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.754414 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:47.764104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.764302 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.764514 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.764786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.776319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.777820 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:47.797054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:47.797948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:47.798846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:47.798846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:47.798846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:47.798846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:47.802969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 413/821] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:47.803830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.844516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf5be-a46c-4754-8cc5-0f8c5afd4bfb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.898505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.899713 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.899999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.900278 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/2d851c6ec2514bdd8660b352254a7965/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.903021 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=2d851c6ec2514bdd8660b352254a7965, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.905000 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:47.919270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138b14-9e72-4b1d-a68a-0efc120b8cf0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:47.923493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 409/822] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:47 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/2d851c6ec2514bdd8660b352254a7965/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:47.926124 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:47.991092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:47.991955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:47.992235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:47.992513 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:47.995333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:47.995649 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:47.997047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:48.010904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 414/823] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:48.015699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:48.027569 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:48.104127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c1b8-e815-4fae-beb4-7029ce728dd2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:48.122454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:48.183527 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:48.185651 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:48.186859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:48.187340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:48.188898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:48.189570 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:48.192733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:48.197689 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5832821-97cc-46d1-b007-596157c529d0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:48.207900 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 410/824] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:48.214267 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:48.249424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:48.250037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:48.250323 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:48.250595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:48.251431 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:48.252793 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:48.280021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 415/825] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:10:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:10:48.327325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88497efb-f680-448f-a9ac-fcb5b36c53e6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:48.337834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:48.374119 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:48.375008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:48.375289 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:48.375563 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:48.384795 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:48.386278 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:48.403194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:48.404231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:48.405875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 411/826] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:10:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:48.410720 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:48.565407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:48.570873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5604-6b70-4c53-b79c-a7163f328861 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:48.618731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:48.619463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:48.619743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:48.620015 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:48.620876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:48.621188 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:48.622660 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:48.644745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 416/827] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:10:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:48.649959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:48.771174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a61663-0dba-43a7-9f9a-246a2fafba3f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:48.806969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:48.807764 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:48.808044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:48.808320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:48.819171 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:48.820560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:48.841348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:48.842270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:48.843352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:48.843352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:48.843352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:48.843352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:48.843352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 412/828] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:48.848151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:48.964222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72ac42-de8a-436e-81e8-5a82e329b1e9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:49.004859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:49.005854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.006338 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.006892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.007795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:49.008272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:49.009810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:49.022244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 417/829] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:49.034819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:49.047185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:49.136635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ce037-2592-4b49-952e-164ed0358982 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:49.172616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:49.173415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.173695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.173967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.181513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:49.182990 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:49.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:49.197749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:49.198714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 413/830] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:49.204091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:49.225783 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:49.314331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ad605-b0c6-454e-870d-09335378a927 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:49.349333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:49.349998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.350278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.350552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.351372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:49.351679 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:49.353095 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610640cd-e773-4dc4-99f9-6554877133bd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:49.367290 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 418/831] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:49.373079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:49.460031 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:49.489858 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d34e-e738-4dd6-868e-5154892e3b48 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:49.533694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d64de1-e532-4e49-a71a-3f1aaf45237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:49.534606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d64de1-e532-4e49-a71a-3f1aaf45237d None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.534915 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d64de1-e532-4e49-a71a-3f1aaf45237d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.535224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d64de1-e532-4e49-a71a-3f1aaf45237d None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/a9627879440241d6b90a3542fef29dab/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.553957 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d64de1-e532-4e49-a71a-3f1aaf45237d None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=a9627879440241d6b90a3542fef29dab, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:49.555510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d64de1-e532-4e49-a71a-3f1aaf45237d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:49.570340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 414/832] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:10:49 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/a9627879440241d6b90a3542fef29dab/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:10:49.669112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81efe1-71cb-4347-a2c2-d306afd2a397 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.669112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81efe1-71cb-4347-a2c2-d306afd2a397 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.669112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81efe1-71cb-4347-a2c2-d306afd2a397 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.669889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 419/833] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:49.676514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4067-fd75-4251-b4d9-20e976095eb7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.676978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4067-fd75-4251-b4d9-20e976095eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.677402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4067-fd75-4251-b4d9-20e976095eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.695949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-436a4067-fd75-4251-b4d9-20e976095eb7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:49.697317 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-436a4067-fd75-4251-b4d9-20e976095eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:49.773703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 415/834] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:49.796900 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81efe1-71cb-4347-a2c2-d306afd2a397 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:49.809040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d961-ad24-43ef-9356-70c2a488f3cc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.809349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d961-ad24-43ef-9356-70c2a488f3cc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.809597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d961-ad24-43ef-9356-70c2a488f3cc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.811278 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 416/835] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:10:49.819323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.819613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.819896 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.864963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:49.867150 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:49.903155 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:49.923232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:49.929569 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81efe1-71cb-4347-a2c2-d306afd2a397 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:49.945103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 417/836] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:49.970971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:49.971722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:49.972761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:49.973390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:49.973817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:49.979892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:49.981806 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:49.998421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:49.999631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:50.000666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:50.004352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 420/837] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:10:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:50.011598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:50.088695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2adf52-e685-462e-9e13-11e58fbed962 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:50.126878 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:50.127690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.128130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.128416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.129699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:50.131414 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:50.145815 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4968-0d19-4cde-9dee-4b3f8d4e461c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:50.146778 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:50.147745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:50.153620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 418/838] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:50.160110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:50.187864 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:50.188565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.188844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.189118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.189828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:50.190133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:50.192091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:50.199385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 421/839] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:50.205087 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:50.215298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:50.231289 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:50.304643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c4d3-34e1-465c-b35a-240e7acfa802 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:50.320115 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806f7c-35ba-4efd-bd9f-1ff4067cb43e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:50.343766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:50.344596 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.344972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.345340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.346253 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:50.346652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:50.348848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:50.358661 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 419/840] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:50.359932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:50.361884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:50.362887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.363903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.364319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.365957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:50.366411 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:50.367952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc31aa-773d-4f08-872d-843f2ce8f6c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:50.373966 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 422/841] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:50.478157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e5f6-5dd4-4958-873e-37fe3763930f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:50.507534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:50.515386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:50.516640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.516922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.517194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.519140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:50.519140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:50.519821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502ef1d-6c21-454d-b3ef-3fa5a5ce5fd1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:50.525811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 420/842] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:50.630820 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa03dc-ecbc-45f8-8043-0600cbf1fbb9 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.631134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa03dc-ecbc-45f8-8043-0600cbf1fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.631391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa03dc-ecbc-45f8-8043-0600cbf1fbb9 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.633235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 423/843] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:50.639269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.639561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.639845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.658266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:50.659518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:50.739681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 421/844] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:50.763710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa03dc-ecbc-45f8-8043-0600cbf1fbb9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:50.840978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:50.874331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa03dc-ecbc-45f8-8043-0600cbf1fbb9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:50.910818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:50.911659 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:50.911943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:50.912218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:50.924376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:50.932962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:50.933998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:50.934917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 424/845] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:50.943111 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:51.067326 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abcbbc-b15f-40ba-8568-30165b0a8198 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:51.074759 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:51.105185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:51.105959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:51.106124 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:51.106382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:51.107158 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:51.107506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:51.108875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:51.118436 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 422/846] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:51.123528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:51.229037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28ee7-a726-4984-95a6-bf9e1dba6eda None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:51.263467 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:51.265392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:51.267796 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:51.267796 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:51.267796 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:51.278817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:51.280313 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:51.298398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:51.299872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:51.301867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:51.301867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:51.301867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:51.301867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:51.301867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 425/847] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:51.306090 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:51.439026 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17728-7fff-4411-8b07-c9080c3f20c6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:51.475149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:51.475817 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:51.476103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:51.476378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:51.477108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:51.477508 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:51.478769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:51.493099 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 423/848] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:51.498565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:51.603111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99fb42-1a70-45fe-8db8-994d77bf46c6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:51.637394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:51.638199 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:51.638484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:51.638760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:51.647678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:51.649131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:51.666485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:51.667704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:10:51.668657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:51.669209 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 426/849] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:10:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:51.686480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:51.718604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:51.796981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d589911-d38f-4e37-8daf-6e9ca5adf2c4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:51.835262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:51.835959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:51.836240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:51.836510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:51.837373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:51.837680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:51.839168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97986166-8dbe-4cf4-bff1-ba35f08bc035 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:51.859657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 424/850] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:10:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:51.871893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:51.917247 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:51.974253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058686-9a15-4450-9ad4-30f8f1eaf510 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.013128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.013797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.014083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.014352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.037517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b70e-cd02-4661-89f3-091603013f27 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.037839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b70e-cd02-4661-89f3-091603013f27 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.038083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b70e-cd02-4661-89f3-091603013f27 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.039791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 425/851] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:52.048071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.048364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.048645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.067615 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:52.069127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:52.092530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.094176 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.141721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.166810 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 426/852] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:52.183226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.208070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.218429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 427/853] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:10:52.219958 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.323647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd450c-4611-487c-90c0-f65ee19f1e34 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.325486 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451fc41-d53c-4434-8bf5-7c9436f1ae5a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.362045 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.363199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.363644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.364073 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.365667 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.366525 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.366885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.367323 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.375614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:52.378110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.379601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.381512 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:52.390912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:52.392193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:10:52.393040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:52.396387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 427/854] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:52.404568 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:52.405385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:52.406253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:52.406253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:52.406253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:52.406253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:52.407799 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.410932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 428/855] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:10:52.412404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.512918 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.515972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b90f-9bcb-434e-af6c-8ae71dbf71c5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.545520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de275b-41a6-4e13-a885-d4978a256eec None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.555058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.556153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.556654 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.557129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.558082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:52.558609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.560291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.577941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 429/856] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:52.585016 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.599903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.600587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.600876 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.601181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.602181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:52.602485 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.604187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.618875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 428/857] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:52.621960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.652152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.721972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1125-720f-4276-b53e-f503c3621f48 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.758883 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275ba5d-e995-430b-ac27-18fed0130475 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.768187 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.769009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.769259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.770026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.777044 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.778478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-52ba5cbf-2e46-4b91-ac20-697d21b571b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:52.793046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:52.793949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:52.795339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 430/858] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:52.795878 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525105-0a15-4a52-b964-6c7e2947000c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.795878 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525105-0a15-4a52-b964-6c7e2947000c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.796169 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525105-0a15-4a52-b964-6c7e2947000c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.797431 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 431/859] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:52.801314 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.801976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525105-0a15-4a52-b964-6c7e2947000c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.802144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.802393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.802662 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.811385 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.817397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.818925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-96b35d46-79fa-4a42-9801-2299f538210e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:52.837740 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:52.838635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:52.839544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:52.839544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:52.839544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:52.839544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:52.839544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 429/860] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:52.840294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.840459 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.840724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.857351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:52.858539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:52.913569 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525105-0a15-4a52-b964-6c7e2947000c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:52.929261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:52.931941 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 430/861] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:52.932692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:52.955334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:52.955996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.956273 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.956548 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.957620 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:52.957930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:52.959376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f422e2-817e-4473-91f8-b6901e896007 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:52.974009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 432/862] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:52.974009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256d55-39ce-4a36-9584-3fb0d6cdc5e8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:52.974009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256d55-39ce-4a36-9584-3fb0d6cdc5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:52.974009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256d55-39ce-4a36-9584-3fb0d6cdc5e8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:52.974009 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 433/863] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:52.975088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256d55-39ce-4a36-9584-3fb0d6cdc5e8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:53.040853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28060e84-2c68-4ac3-a49d-f46c3e7c9195 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.061065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:53.076313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.076880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256d55-39ce-4a36-9584-3fb0d6cdc5e8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.076989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.077245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.077526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.078254 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:53.078565 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.079965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:53.091057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 431/864] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:53.091845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:53.110517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79710e5f-bb8a-4dcb-9a8f-32ff486a2ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.111218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710e5f-bb8a-4dcb-9a8f-32ff486a2ac1 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.111505 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710e5f-bb8a-4dcb-9a8f-32ff486a2ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.111780 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710e5f-bb8a-4dcb-9a8f-32ff486a2ac1 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.112501 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79710e5f-bb8a-4dcb-9a8f-32ff486a2ac1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.114395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79710e5f-bb8a-4dcb-9a8f-32ff486a2ac1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:53.127156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 434/865] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:10:52 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:53.128376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.129230 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.129510 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.149152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:53.150842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:53.185934 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:53.207890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b850efd-845e-402e-bca6-a6b87241c344 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.242408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 435/866] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:53 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:53.243404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:53.244331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.245000 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.245283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.245564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.246406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=2d851c6ec2514bdd8660b352254a7965) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:53.246711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.248199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:53.270856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 432/867] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:53 2022] GET /identity/v3/role_assignments?user.id=2d851c6ec2514bdd8660b352254a7965&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:53.270856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:53.340091 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:53.395954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beb0e3-c4d9-45ae-b46b-3ea126a16880 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.424199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20166-d86b-487b-8321-93c23b11f49f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.441465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.442453 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.442742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.443063 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.452356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.453809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:53.462323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.463042 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.463328 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.463601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.464382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.465710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:53.474914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:53.475953 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:53.476898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:53.480936 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 436/868] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:10:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:53.482266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:53.484476 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 433/869] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:10:53 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:10:53.510171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:53.611280 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b621af6-c220-4d0f-8371-5787840559fb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.656853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.657954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.658443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.658997 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.660595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:53.661112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.662756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:53.682236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 437/870] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:10:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:53.687632 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:53.799111 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5be371-ba2f-47f0-a7e9-8915da093d39 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:53.802435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:53.839096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:53.840043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:53.840490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:53.840924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:53.918895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:53.918895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:54.025658 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 434/871] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:10:54.031046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:54.109471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:54.140656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5a4c3-1b48-4fe1-a95d-0a353227df0f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:54.175961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:54.176670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:54.176950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:54.177219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:54.187508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:54.188948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:54.207293 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:54.208170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:54.209034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:54.209034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:54.209034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:54.209034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:54.209034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 438/872] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:54.214372 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:54.218228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:54.322698 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4abaeb-dd51-43e5-8717-96b186bd3e02 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:54.362453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:54.363521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:54.363938 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:54.364343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:54.365397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:54.365705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:54.367145 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:54.381585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 435/873] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:54.386967 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:54.497036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6a422-14aa-43aa-adda-9a8cdac3a2ee None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:54.524576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:54.534371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:54.535503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:54.535985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:54.536464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:54.543668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:54.545334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:54.560497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:54.561464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:54.562354 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:54.569210 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 439/874] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:54.571880 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:54.639430 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:54.680807 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb35a-6179-49da-8e94-f93ea048764a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:54.719701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:54.720370 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:54.720831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:54.721109 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:54.721904 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:54.722247 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:54.723719 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4c44-61ba-4e8a-8a0d-99b046654b7d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:54.737268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 436/875] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:54.744105 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:54.852610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4fef-8816-485b-9b0a-13e42ef3c452 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:54.887803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:54.888460 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:54.888744 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:54.889019 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:54.889861 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=a9627879440241d6b90a3542fef29dab) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:54.890174 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:54.891886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25e952-8d80-47dc-b809-6b8fc0dbb7ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:54.898750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 440/876] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:54 2022] GET /identity/v3/role_assignments?user.id=a9627879440241d6b90a3542fef29dab&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:55.542461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044270e1-df25-4a14-b8cd-f43e0458ba3e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:55.543009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044270e1-df25-4a14-b8cd-f43e0458ba3e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:55.543118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044270e1-df25-4a14-b8cd-f43e0458ba3e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:55.544647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 437/877] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:55.550045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9e9c-03cf-4fa4-9654-34f22cefec0a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:55.551026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9e9c-03cf-4fa4-9654-34f22cefec0a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:55.551193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9e9c-03cf-4fa4-9654-34f22cefec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:55.568590 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3cab9e9c-03cf-4fa4-9654-34f22cefec0a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:55.569779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3cab9e9c-03cf-4fa4-9654-34f22cefec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:55.619247 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:55.640433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 441/878] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:55.663741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044270e1-df25-4a14-b8cd-f43e0458ba3e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:55.702943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dc2da-bd5a-401f-9c9a-f51ee003b8f4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:55.703300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dc2da-bd5a-401f-9c9a-f51ee003b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:55.703503 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dc2da-bd5a-401f-9c9a-f51ee003b8f4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:55.705208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 442/879] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:10:55.711405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:55.711723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:55.711965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:55.731829 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:55.733013 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:55.776994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044270e1-df25-4a14-b8cd-f43e0458ba3e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:55.808253 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:55.815365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 443/880] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:55.825777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:55.826600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:55.826910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:55.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:55.827845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:55.829213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:55.839194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:55.845382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:55.846346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:55.847992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 438/881] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:10:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:55.852901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:55.949300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5677-0965-408c-bab5-97b15a1868a4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:55.961572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:55.968242 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1eb52-d65a-4548-8ca8-f0a9d8d46cb5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:55.987225 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:55.988051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:55.988334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:55.988606 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:55.989318 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:55.990687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-621c2bf4-65aa-4e1a-9eb7-d819d8c05ea8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:56.002617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:56.003668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:56.004482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 444/882] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:56.005269 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdc852-b9c6-4b82-b739-82eb1d64a053 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.005269 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdc852-b9c6-4b82-b739-82eb1d64a053 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.005965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdc852-b9c6-4b82-b739-82eb1d64a053 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.006887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 445/883] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:56.010107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.010804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.011138 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.011415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.011715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdc852-b9c6-4b82-b739-82eb1d64a053 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.012225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.012641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.014017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9fb0b-750f-4040-9f05-9857d49c8fc6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.024969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 439/884] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.024969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.024969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.024969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.039668 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:56.040843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:56.092280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:56.114890 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 440/885] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:56.116030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.139879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdc852-b9c6-4b82-b739-82eb1d64a053 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.179780 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.180449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.180729 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.181000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.181703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.182013 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.183405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.193012 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 446/886] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.194449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.233438 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da489f-0c53-416a-a27f-c1f756c25885 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.238029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:56.271173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.271837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.272113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.272378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.273086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.273390 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.274891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.285166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 441/887] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.285166 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.304278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c127b-7d23-4309-9a3f-2b878ce00a6d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.334168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:56.341573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.342375 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.342676 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.342974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.343628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.344980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:56.356669 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:56.357690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:56.358508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 447/888] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:56.359831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.393157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd622aa-ba1b-4a78-9469-f5ba1b658788 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.432309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.433205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.433646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.434073 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.434781 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.435115 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.436472 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.441516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 442/889] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.442282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8299c-d952-4096-bfe1-ae21472fecec None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.482000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:56.522560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.523728 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.524233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.524706 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.525721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] RBAC: Adding query filter params (interface=public, service_id=e7107fb6b63540c0b54abf7a8a97ef25, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.526246 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.528057 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.538944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 448/890] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/endpoints?service_id=e7107fb6b63540c0b54abf7a8a97ef25&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.540326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.561897 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c13c64-e9af-41b2-b826-314ce34a20f4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.575261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:56.602724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.603495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.603774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.604050 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.604825 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.605135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.606827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.612646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 443/891] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.618377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.666945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf7c3-bbef-46d1-9999-4e22ecba0bde None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.705957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.707495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.707918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.708344 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.709217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.710985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.717239 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 449/892] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:10:56.743722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5f19-5506-4ad0-90ff-72dfea5067c1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.784253 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.785453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.785736 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.786011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.786760 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.787101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.788538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.794703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 444/893] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:56.800828 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:56.837639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:56.926671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db14f6-3cac-41e2-8fb1-2a4a92f021a3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:56.962982 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:56.963652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:56.963935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:56.964208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:56.964999 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] RBAC: Adding query filter params (interface=public, service_id=b60ca3bda20145e6be637f1803c1f38d, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:56.965310 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:56.966671 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab62731-9b6b-429d-90c5-c354747a1fb6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:56.973294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 450/894] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/endpoints?service_id=b60ca3bda20145e6be637f1803c1f38d&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:56.978665 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:57.020452 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:57.091133 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de180dd3-4b67-40ac-ab1f-049b3f6de074 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:57.134853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4bfa-b3c7-4196-ad84-59bd1ce4d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:57.135887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4bfa-b3c7-4196-ad84-59bd1ce4d31b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:57.136393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4bfa-b3c7-4196-ad84-59bd1ce4d31b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:57.136887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4bfa-b3c7-4196-ad84-59bd1ce4d31b None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:57.137766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c4bfa-b3c7-4196-ad84-59bd1ce4d31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:57.139370 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c4bfa-b3c7-4196-ad84-59bd1ce4d31b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:57.147177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 445/895] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:10:56 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:10:57.262898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e594a5-e26f-4f37-83ed-9ed46a2c6e79 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:57.263226 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e594a5-e26f-4f37-83ed-9ed46a2c6e79 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:57.263457 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e594a5-e26f-4f37-83ed-9ed46a2c6e79 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:57.265107 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 451/896] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:57.273192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:57.273621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:57.274087 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:57.293434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:57.294652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:57.369922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 446/897] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:57.398878 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e594a5-e26f-4f37-83ed-9ed46a2c6e79 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:57.502761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:57.511719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e594a5-e26f-4f37-83ed-9ed46a2c6e79 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:57.548753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:57.549868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:57.550916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:57.551399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:57.562567 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:10:57.571901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:57.572816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:10:57.573626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:57.575905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 452/898] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:10:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:57.582343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:57.614133 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:57.688118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b8ec-e286-492e-8d75-77a507eb9df6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:57.728652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:57.729645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:57.730076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:57.730497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:57.731470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:57.731917 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:57.733495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:57.743605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 447/899] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:10:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:57.749334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:57.859407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88136abe-169b-43c6-b1e2-4fb12bc0122a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:57.898215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:57.899316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:57.899741 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:57.900154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:57.912495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:57.914237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:57.932883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:57.933937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:57.935141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:57.935141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:57.935141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:57.935141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:57.937025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 453/900] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:57.942813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:58.045625 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:58.053050 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcc432-9399-40aa-9be0-a2fc6f12b28a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:58.086643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:58.087332 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.087613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.087886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.088605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:58.088906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:58.090258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:58.102769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 448/901] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:58.108268 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:58.119321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:58.218039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e106c-502c-46c1-a887-425cfb161555 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:58.254962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:58.256137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.256709 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.257203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.265478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:58.267470 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:10:58.282807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:58.283824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:10:58.284926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:58.287815 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 454/902] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:10:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:58.293819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:58.402733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9c365-361c-4476-97d3-a57f34567043 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:58.440509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:58.441798 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.442078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.442345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.443213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:58.443519 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:58.444954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:58.462846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 449/903] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:10:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:58.467979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:58.539631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:58.578633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388bd8-e585-4972-bbba-4d0826b35d91 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:58.614435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b5133-575d-4c4d-8ce7-c3517f6bd2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:58.615116 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5133-575d-4c4d-8ce7-c3517f6bd2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.615397 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5133-575d-4c4d-8ce7-c3517f6bd2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.615672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5133-575d-4c4d-8ce7-c3517f6bd2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.687556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b5133-575d-4c4d-8ce7-c3517f6bd2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:58.688994 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b5133-575d-4c4d-8ce7-c3517f6bd2e4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:58.760824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:58.802859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 455/904] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:10:58 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:10:58.808699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:58.825601 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:58.918185 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164b27-1238-41f8-a557-6000a282eea6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:58.951461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb0f3-68f7-4196-8a5d-94054f3d4425 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.951858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb0f3-68f7-4196-8a5d-94054f3d4425 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.952240 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb0f3-68f7-4196-8a5d-94054f3d4425 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.953969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 456/905] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:10:58.954152 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:58.954885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.955231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.955503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.959959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eedfb0-f6dc-426c-8849-05beb96db9a2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:58.960245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eedfb0-f6dc-426c-8849-05beb96db9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:58.960518 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eedfb0-f6dc-426c-8849-05beb96db9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:58.967453 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:58.968912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:58.978635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-49eedfb0-f6dc-426c-8849-05beb96db9a2 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:58.979860 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-49eedfb0-f6dc-426c-8849-05beb96db9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:10:58.987768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:58.989768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:58.991875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:10:58.991875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:10:58.991875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:10:58.991875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:58.991875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 450/906] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:58.996038 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.057347 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 457/907] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:10:59.058673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790a89a-487e-4817-a9c3-f906ff2996a0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.059054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790a89a-487e-4817-a9c3-f906ff2996a0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.059333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790a89a-487e-4817-a9c3-f906ff2996a0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.062817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 458/908] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:59.066144 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.066966 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.067399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.082208 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.086959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:59.088162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:59.119011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96ea69-0eb1-45eb-a70b-a54aa14f87aa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.160511 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.161283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 459/909] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:10:59.161398 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.161476 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.161708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.162432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:59.162835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.163822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.164219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.181091 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 451/910] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:59.182077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.196915 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.278207 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005d794-301f-4318-847e-4ca5041bd386 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.293110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46f8d-e8cb-4d13-b041-3313554a6c93 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.312585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.313186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.313474 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.313745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.314472 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.316407 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.318120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.330221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.330892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 460/911] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:10:59 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:10:59.332027 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.332613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.333082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.335875 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.349439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.351584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:10:59.369256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:59.370269 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:10:59.371264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:10:59.374184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 452/912] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:59.380258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.456774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.481392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544351e-3e9d-4bc6-b4db-2bfaae9d1f43 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.512943 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6892c-9a4e-443f-ac3a-56e99f1f6af7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.522298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.523162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.523445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.523722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.524399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.525792 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-13c3c034-9105-4776-a84f-eff17bb4052b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:59.539715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:59.540651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:59.541481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 461/913] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:59.542305 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1e26-b3d4-45b8-9960-50d59547b122 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.542374 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1e26-b3d4-45b8-9960-50d59547b122 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.542869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1e26-b3d4-45b8-9960-50d59547b122 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.544814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 462/914] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:10:59.547284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff1e26-b3d4-45b8-9960-50d59547b122 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.559240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.559914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.560202 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.560593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.561398 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:59.561710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.563345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76fc87-8b3a-4642-be18-93042f9529d8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.577193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 453/915] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:59.578477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.578884 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.583148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.601780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:10:59.603011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:10:59.644893 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.661742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff1e26-b3d4-45b8-9960-50d59547b122 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.674752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 454/916] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:10:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:10:59.683936 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.699492 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.700159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.700488 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.700764 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.701522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:59.701832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.703270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.710825 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 463/917] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:10:59.710825 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.728192 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.793184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2bf04-4c64-4347-8f0f-1be5f99befde None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.820529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aff2e-c798-4a3e-aec7-32d2abf74e02 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.828105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.828771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.829055 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.829331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.830169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] RBAC: Adding query filter params (role.id=3d58e3fa240346389e971da8c3630182, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=a9627879440241d6b90a3542fef29dab) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:10:59.830481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.832491 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.838314 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 455/918] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/role_assignments?user.id=a9627879440241d6b90a3542fef29dab&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=3d58e3fa240346389e971da8c3630182 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:10:59.839422 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.869814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:10:59.871169 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:10:59.871710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:10:59.872325 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:10:59.873353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:10:59.875034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:10:59.888818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:10:59.889892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:10:59.890724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:10:59.892611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:10:59.899373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 464/919] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:10:59.900943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:10:59.981528 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7fcfb-296d-4344-bbf0-a556e2d1574d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:10:59.991264 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:00.019716 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6af9f-ca3d-4d1c-b7a1-addae949fe74 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:00.032240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:00.032444 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:00.032735 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:00.034142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:00.034142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:00.034142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:00.036007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:00.041575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 456/920] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:00.047931 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:00.064203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:00.065161 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:00.065447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:00.066724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:00.067650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:00.068091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:00.069752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:00.076550 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 465/921] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:10:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:00.082139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:00.168032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6626b-2ff7-4a2d-a872-f77628ce70c4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:00.169734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:00.214014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df3d0b-3267-4265-bf00-73f98573399f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:00.217423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:00.218330 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:00.218865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:00.219346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:00.220296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:00.222338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:00.254924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 457/922] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:11:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:11:00.266493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:00.267319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:00.267663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:00.268121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:00.269740 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:00.270061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:00.271723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56337d2-c86c-4301-bc9a-d1ddb7ea8869 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:00.273482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:00.280768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 466/923] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:11:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:00.287040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:00.410190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d9f2-4b71-4a39-8cc3-27e6fb42821b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:00.448883 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837198-e9c5-4e1e-ab30-00c323dbdb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:00.449922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837198-e9c5-4e1e-ab30-00c323dbdb36 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:00.450405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837198-e9c5-4e1e-ab30-00c323dbdb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:00.450927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837198-e9c5-4e1e-ab30-00c323dbdb36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:00.451903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837198-e9c5-4e1e-ab30-00c323dbdb36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:00.453597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837198-e9c5-4e1e-ab30-00c323dbdb36 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:00.480872 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 458/924] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:11:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:01.585879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ea11-b6ef-4c45-a9f5-b94985c006b2 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:01.586427 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ea11-b6ef-4c45-a9f5-b94985c006b2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:01.586427 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ea11-b6ef-4c45-a9f5-b94985c006b2 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:01.588040 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 467/925] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:01.593526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:01.593942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:01.594113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:01.610734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:01.611935 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:01.622422 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:01.694917 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 459/926] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:01.714051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977ea11-b6ef-4c45-a9f5-b94985c006b2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:01.823584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977ea11-b6ef-4c45-a9f5-b94985c006b2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:01.858205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:01.859395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:01.859882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:01.860353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:01.861228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:01.862831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:01.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:01.876068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:01.876937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:01.880218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 468/927] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:11:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:01.887516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:01.993181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b321e8a-d01c-410f-bdfa-df511b4df4e7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.030028 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.030708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.031018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.031293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.032080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:02.032319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.033704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ef8c-82ca-44f6-bfd8-4afac87341a2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.039863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 460/928] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:02.045333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.116643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:02.141492 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1998-adf1-4f98-bd8b-c5572def035f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.141835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1998-adf1-4f98-bd8b-c5572def035f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.142063 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1998-adf1-4f98-bd8b-c5572def035f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.144281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 461/929] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:02.149573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.149995 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.150489 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.157751 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:02.162599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88563-77a7-4c8e-bc20-39c493d424c8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.170300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:02.171815 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:02.207497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.208172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.209015 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.209304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.210025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:02.210608 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.218652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.218652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 469/930] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:02.225963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.269671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 462/931] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:02.291718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.342882 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52db7fa-1434-4b98-af6e-a81feeaf7d60 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.383320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:02.394395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.395913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.396038 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.396401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.397625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] RBAC: Adding query filter params (interface=public, service_id=1c12f4cf8f654d4bb3fce4e28113b17f, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:02.398137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.399902 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.413088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 470/932] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/endpoints?service_id=1c12f4cf8f654d4bb3fce4e28113b17f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:02.414195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.415082 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cc7ec-0417-41cb-9f9a-4e0f021e1aee None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.463064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.464675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.465362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.465791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.468783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:02.484457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:02.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:02.498207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:02.499279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:02.502581 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 463/933] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:02.513557 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.532485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee7d71-3b68-4e1b-9391-32f3adf17a00 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.585684 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f8e6-a074-456c-bae4-bd9b1a0e761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.586656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f8e6-a074-456c-bae4-bd9b1a0e761a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.587228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f8e6-a074-456c-bae4-bd9b1a0e761a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.587575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f8e6-a074-456c-bae4-bd9b1a0e761a None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.589036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09f8e6-a074-456c-bae4-bd9b1a0e761a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.590779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09f8e6-a074-456c-bae4-bd9b1a0e761a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.600453 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 471/934] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:11:02.641006 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30248e5-d48b-4ab4-9a82-b8823acf06f2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.672596 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bdb5-eda5-45cb-8c32-5992cc164e58 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.672877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bdb5-eda5-45cb-8c32-5992cc164e58 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.673160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bdb5-eda5-45cb-8c32-5992cc164e58 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.675493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 472/935] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:02.681363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.681640 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.681922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.684441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.685148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.685575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.685848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.686678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:02.687391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.689978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.700289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:02.701513 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:02.701717 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 464/936] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:02.707555 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.760952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:02.787256 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 473/937] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:11:02.788313 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:02.805790 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.842225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a577-43ed-4c99-878c-4910cd7f792b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.879271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.880073 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.880356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.880634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.891538 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.892984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b1e154ea-3c99-418d-90b4-55dc67894ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:02.910932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:02.911854 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:02.912780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:02.912780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:02.912780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:02.912780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:02.912780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 465/938] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:02.913415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67673048-7993-44a5-b9c5-3dfc4a9ac598 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.913701 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67673048-7993-44a5-b9c5-3dfc4a9ac598 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.913977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67673048-7993-44a5-b9c5-3dfc4a9ac598 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.919181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 466/939] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:02.919181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67673048-7993-44a5-b9c5-3dfc4a9ac598 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:02.935685 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff812d3-9b61-4f6d-9a1a-258edc89af30 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:02.975680 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:02.977263 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.977777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.978450 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] PATH_INFO: `/v3/services/compute` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:02.979607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:02.981738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a0ac52ba-78fc-4c9a-8e30-55a3e992eded None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:02.994830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:02.996017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:02.996840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 474/940] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:02.997621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:02.997621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:02.997621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.014476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:03.015972 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:03.033111 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67673048-7993-44a5-b9c5-3dfc4a9ac598 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.043699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.066234 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.072036 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.072711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.072996 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.073279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.074008 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:03.074320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.075718 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.088612 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 467/941] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:03.089530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.096361 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 475/942] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:03.098004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.202180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cb8e-10ff-4fb0-9b6e-08e650343604 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.213283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab2d9-e986-45a4-8658-bf959b9e9702 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.239403 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.240075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.240474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.240752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.241580 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:03.241889 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.243412 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.249195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.250005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.250288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.250559 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.253584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 468/943] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:03.254547 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.259347 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.260777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:11:03.277479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:03.278624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 476/944] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:03.279593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.292869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.319727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.367676 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902679-c32b-4ffe-af72-ccf9369e4221 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.380630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbe026-7c07-4fd1-8b3c-f115a6c6466f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.410960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.411639 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.411921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.412200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.412911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.414356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.415756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: WARNING keystone.server.flask.common [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:11:03.419278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.419944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.420222 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.420496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.421201 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:03.421505 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.422885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.428234 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 477/945] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:03.434102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.sql.core [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:11:03.434102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:11:03.434102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [parameters: {'id': '53769418210c474480a3fdf4fe471a52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:11:03.434102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80246) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:11:03.439847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53769418210c474480a3fdf4fe471a52.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53769418210c474480a3fdf4fe471a52. May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:11:03.442518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 14:11:03.443448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application yield resource May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise self.value May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application session.commit() May 19 14:11:03.444434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.flush() May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application compat.raise_( May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:11:03.445323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:11:03.446993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:11:03.448439 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [parameters: {'id': '53769418210c474480a3fdf4fe471a52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.450268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:03.451769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53769418210c474480a3fdf4fe471a52. May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 469/946] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:11:03 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:03.453363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.559345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.585019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad67e69-76e3-4dd4-a47b-cfaf5be9cf7c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.592770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873fc70-cdc0-4f0f-ab4e-fea6938c573d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.595954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.634955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.635860 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.636105 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.636224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.636580 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.637287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.637715 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.638131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.639280 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:03.639840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.641690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.645024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.646664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.661870 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 478/947] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:11:03.666487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:03.667535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:03.668406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 470/948] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:03.668884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.670005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.782641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8902e9-26cc-4e16-ba30-32696c6c1a42 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.792245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002a55-f585-4eeb-95df-abaa42b86152 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:03.825134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.826055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.826363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.826699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.837654 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:03.838370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.838692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:03.839135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:03.839566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:03.840072 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.840809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:03.841258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:03.843635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:03.858845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:03.859964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:03.861069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:03.861069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:03.861069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:03.861069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:03.866987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 479/949] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:03.868859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:03.873823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 471/950] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:03.886777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:03.984900 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943fc86-c8bb-417d-8b39-fd1633c2a0b6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:04.023315 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:04.024257 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:04.024684 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:04.025100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:04.026025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:04.026506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:04.028067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:04.041942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 480/951] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:04.047842 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:04.063229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:04.156417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c703d20-5f64-4337-8957-469869dc2546 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:04.197466 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:04.198324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:04.198608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:04.198901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:04.206603 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:04.208083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:11:04.222982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:04.223969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:04.225338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 472/952] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:04.230947 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:04.309189 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:04.340493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92a764-17ac-4565-b6b1-313dbcca0295 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:04.374810 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:04.375472 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:04.375754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:04.376029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:04.376812 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:04.377116 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:04.380099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a87c4-6323-461b-8158-5832bcf7f2ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:04.393109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 481/953] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:04.405334 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:04.476223 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:04.510970 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8eecd-8553-495c-bde0-62a709c3e8db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:04.546809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3768f-e78b-4dae-a66f-dee04665aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:04.547710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3768f-e78b-4dae-a66f-dee04665aeff None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:04.547985 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3768f-e78b-4dae-a66f-dee04665aeff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:04.548263 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3768f-e78b-4dae-a66f-dee04665aeff None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/a9627879440241d6b90a3542fef29dab/roles/3d58e3fa240346389e971da8c3630182` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:04.550592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3768f-e78b-4dae-a66f-dee04665aeff None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=a9627879440241d6b90a3542fef29dab, role_id=3d58e3fa240346389e971da8c3630182)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:04.552051 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3768f-e78b-4dae-a66f-dee04665aeff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:04.570675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 473/954] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:11:04 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/a9627879440241d6b90a3542fef29dab/roles/3d58e3fa240346389e971da8c3630182 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:11:04.952459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619d5a3-c0e1-4d9a-bbfc-a490fd032da7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:04.953458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619d5a3-c0e1-4d9a-bbfc-a490fd032da7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:04.953940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619d5a3-c0e1-4d9a-bbfc-a490fd032da7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:04.955910 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 482/955] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:04.961695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:04.962512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:04.963033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:04.980832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:04.982828 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:05.056368 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 474/956] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:05.079394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619d5a3-c0e1-4d9a-bbfc-a490fd032da7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:05.185093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619d5a3-c0e1-4d9a-bbfc-a490fd032da7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:05.217327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:05.222063 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:05.222889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:05.223173 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:05.223440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:05.224109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:05.225504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:05.238511 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:05.239662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:05.240490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 483/957] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:11:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:05.246225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:05.307996 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:05.353823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36a8ae-f1de-4ba3-8dcf-22d61d86fe7f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:05.389045 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:05.389714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:05.389993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:05.390266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:05.391270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:05.391573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:05.392948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:05.402928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 475/958] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:05.404775 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:05.525445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c652f-618c-49b0-861b-1c9b06ea6d86 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:05.564121 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:05.564803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:05.565094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:05.565385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:05.566117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:05.566426 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:05.567846 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922c882-d06a-45fa-8699-21b847a088a0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:05.573986 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 484/959] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:05.579606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:05.687553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b398d-6d7e-4168-9dfe-0ba587ac59bf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:05.711853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:05.724902 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:05.725568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:05.725852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:05.726127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:05.726921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:05.728300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:05.738032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdec4-7845-434c-822a-132940d7ff5b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:05.738300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdec4-7845-434c-822a-132940d7ff5b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:05.738586 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdec4-7845-434c-822a-132940d7ff5b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:05.741207 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 485/960] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:05.750263 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 476/961] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:11:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:05.754410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244958d-685d-4a35-8ac6-0e7fa774f133 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:05.754997 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244958d-685d-4a35-8ac6-0e7fa774f133 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:05.755410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244958d-685d-4a35-8ac6-0e7fa774f133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:05.778527 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2244958d-685d-4a35-8ac6-0e7fa774f133 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:05.779813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2244958d-685d-4a35-8ac6-0e7fa774f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:05.865289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:05.885440 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 486/962] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:05.909818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:06.022534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1c55-1631-4223-a358-61fa40c07c7f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:06.058440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534e04-c67f-4829-b675-b40ea1b529e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:06.059056 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534e04-c67f-4829-b675-b40ea1b529e9 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.059341 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534e04-c67f-4829-b675-b40ea1b529e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.059617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534e04-c67f-4829-b675-b40ea1b529e9 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.060347 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534e04-c67f-4829-b675-b40ea1b529e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:06.061715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534e04-c67f-4829-b675-b40ea1b529e9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:06.077171 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 477/963] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:11:05 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:06.449446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c5c1-c068-4e28-a690-db4360be5da5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.449964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c5c1-c068-4e28-a690-db4360be5da5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.449964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c5c1-c068-4e28-a690-db4360be5da5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.451626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 487/964] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:06.456913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.457373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.457802 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.475605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:06.477065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:06.509921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:06.562891 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 478/965] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:06.584276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c5c1-c068-4e28-a690-db4360be5da5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:06.707353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c5c1-c068-4e28-a690-db4360be5da5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:06.741800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:06.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.742754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.743056 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.743779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:06.745236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:06.746597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: WARNING keystone.server.flask.common [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:11:06.763076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.sql.core [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:11:06.763076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:11:06.763076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [parameters: {'user_id': 'f75ba2b26db44cd1a957982abca6470b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:11:06.763076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1d4f1f9f-6796-4a10-a9fd-1eba937923db None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() May 19 14:11:06.781120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:11:06.782059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application yield resource May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise self.value May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application session.commit() May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:11:06.783036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.flush() May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application compat.raise_( May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:11:06.783998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:11:06.784883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:11:06.785731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f75ba2b26db44cd1a957982abca6470b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:06.786555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 14:11:06.789248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:06.791420 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 488/966] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:11:06 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:06.792303 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:06.894631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa809c-4dd2-4027-92a6-03e20ef3cd0d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:06.952034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584834e-2450-4dd8-b7c9-eabea4899733 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.952391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584834e-2450-4dd8-b7c9-eabea4899733 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.952560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584834e-2450-4dd8-b7c9-eabea4899733 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.962517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 489/967] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:06.964349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.964951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.965060 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:06.965581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.965835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:06.966083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:06.966365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:06.976375 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:06.977472 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:06.988487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:06.990270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:11:06.993886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:06.994827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:06.995775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 479/968] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:07.000804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:07.027924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:07.047176 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:07.075021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 490/969] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:07.094146 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:07.110841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5cc3b-f7c0-4583-9db2-40c10f8fc1ab None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:07.150919 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:07.151605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:07.151880 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:07.152159 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:07.153147 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:07.153958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:07.155742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:07.210882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 480/970] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:11:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:07.214030 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936368c7-c925-4f9f-a366-ae6392c42f31 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:07.257554 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:07.258892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:07.259417 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:07.259950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:07.276578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:07.287392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:07.288600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:07.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:07.292493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 491/971] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:11:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:07.298958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:07.414077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:07.439127 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f345b-a924-4746-8101-f7a8651bdbaa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:07.476461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:07.477465 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:07.477956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:07.478455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:07.479466 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:07.479994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:07.481563 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:07.490980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 481/972] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:11:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:07.497480 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:07.547262 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:07.610533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492a302-b450-42a9-aa4b-103c4b7ac258 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:07.647970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:07.648762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:07.649045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:07.649318 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:07.660269 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:07.661850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:07.679071 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:07.679978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:07.680859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:07.680859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:07.680859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:07.680859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:07.680859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 492/973] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:07.686813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:07.788468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e9a9a-433d-4ddb-ac1f-15091ea681df None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:07.821851 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:07.822524 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:07.822822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:07.823105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:07.823834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:07.824142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:07.825520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:07.842496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 482/974] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:07.843779 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:07.943615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:07.954581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ea6f-5702-4978-b7ca-48aa7e659830 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:07.988798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:07.989608 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:07.989889 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:07.990213 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:07.997813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:07.999276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-829da270-65b4-4238-b9b0-bc228fc2f932 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:11:08.014383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:08.015849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:11:08.016827 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:08.017946 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 493/975] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:11:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:08.021552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.026487 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.103869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9885a4-6819-432d-ba2f-1977b1437136 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.104141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9885a4-6819-432d-ba2f-1977b1437136 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.104350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9885a4-6819-432d-ba2f-1977b1437136 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.105813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 494/976] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:08.110913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.111273 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.111553 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.129333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:08.130507 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:08.130704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d9fd-a2de-47db-b264-5231d0caec05 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.167724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.168400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.168688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.168968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.169809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:08.170123 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.171592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.191430 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 483/977] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:08.197173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.208065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 495/978] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:08.230485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.270138 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.312723 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a299-a494-4abf-b9e6-77eaeab12053 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.316942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.336111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1b5b-942e-482e-98ea-fafd0126596a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.351873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3fafd-9a9f-478a-adee-29e9c322786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.352521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fafd-9a9f-478a-adee-29e9c322786c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.352801 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fafd-9a9f-478a-adee-29e9c322786c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.353075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fafd-9a9f-478a-adee-29e9c322786c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.375154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.375892 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.376171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.376861 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.377549 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.379053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:08.391708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:08.392733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:08.393579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 496/979] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:08.400365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.432526 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3fafd-9a9f-478a-adee-29e9c322786c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.433969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3fafd-9a9f-478a-adee-29e9c322786c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.493832 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.498926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc780c6-70d3-4ca2-b1a3-f3e2540c55b4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.531948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.532609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.532891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.533166 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.534408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:08.534501 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 484/980] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:11:08.534719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.535869 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859764af-05c1-45f6-82e7-1a44e247a572 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.536113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0abf-6c3b-4df3-89af-2cb45fdd59a0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.536219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859764af-05c1-45f6-82e7-1a44e247a572 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.536434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859764af-05c1-45f6-82e7-1a44e247a572 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.537867 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 485/981] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:08.545707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 497/982] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:08.545843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859764af-05c1-45f6-82e7-1a44e247a572 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.545922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.545922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.545922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.560435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:08.561618 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:08.563601 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.630054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 498/983] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:11:08.630843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.655235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859764af-05c1-45f6-82e7-1a44e247a572 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.689646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.691003 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.691285 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.691561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.701560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.703030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:08.720477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:08.721518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:08.722944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:08.722944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:08.722944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:08.722944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:08.722944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 486/984] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:08.723611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.728738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ccbf-23c7-47e6-b1bb-f9a15a7a917c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.739052 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.763736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.764406 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.764686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.764962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.765930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:08.766238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.767626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.772852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 499/985] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:08.773627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.776109 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.824100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae9d16-d495-441f-9757-b08919863d2f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.858516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.859330 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.859618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.859902 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.860553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.861954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.871465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db78a6-b604-40d6-9a93-c483cacfe597 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:08.873911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:08.875129 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:08.875981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 487/986] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:08.876783 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.906288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:08.907016 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:08.907299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:08.907575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:08.908297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:08.908604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:08.910504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:08.921668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 500/987] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:08.922451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:08.956514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:08.978990 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493c1c-045c-4ce9-8462-9346a75094fb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:08.984705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:09.011707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.012365 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.012649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.012924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.013722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] RBAC: Adding query filter params (interface=admin, service_id=1c12f4cf8f654d4bb3fce4e28113b17f, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:09.014035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.015730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.023604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 488/988] 10.222.0.71 () {56 vars in 1249 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/endpoints?service_id=1c12f4cf8f654d4bb3fce4e28113b17f&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:09.023924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164be49e-7c56-47c5-a3a5-2e0b3008e817 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.024383 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.058867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.059533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.059812 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.060093 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.060797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:09.061104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.062456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.067691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 501/989] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:09.068458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.125749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a80df-9d14-46c3-a9fa-d3e4618bac37 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.160120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.160849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.161130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.161402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.168200 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.169635 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.169731 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441e8a-78fc-4532-9a26-4819cee19dcb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:11:09.183839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:09.184882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 489/990] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:09.185777 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.188330 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:09.199036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:09.208055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.208717 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.209126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.209396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.211456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.217750 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 502/991] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:11:09.218352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.301355 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45285b-5a85-42bf-9eb3-d9a0f2cb122a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.338881 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.339564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.339844 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.340113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.340836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:09.341139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.342546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.344494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69c20d-dd3c-4d5b-ae1b-a38e50be5cdd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.348517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 490/992] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:09.355075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.385853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.386521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.386816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.387273 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.387932 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:09.388285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.389749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.404205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 503/993] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:09.410424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.440641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:09.465433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:09.474942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b8b58-71cc-406b-b794-cc19e3474c5b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.513180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.513870 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.514153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.514438 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] RBAC: Adding query filter params (interface=public, service_id=f7e10446a1da4004a2d20c62f19ac2e8, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:09.515840 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.517210 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.518034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e934d-9fb8-4952-87af-0a4cf31141a7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.522606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 491/994] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/endpoints?service_id=f7e10446a1da4004a2d20c62f19ac2e8&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:09.527967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:09.560580 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.561260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.561537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.561807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.562641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] RBAC: Adding query filter params (role.id=3d58e3fa240346389e971da8c3630182, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=a9627879440241d6b90a3542fef29dab) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:09.562979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.564399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5e3a6-d18c-4246-b93c-a0a38bc2d3eb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.571245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 504/995] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/role_assignments?user.id=a9627879440241d6b90a3542fef29dab&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=3d58e3fa240346389e971da8c3630182 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:09.649155 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a4812-863c-4360-87d8-8ec4646bcbfa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:09.681711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:09.689198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7afa7-1277-4bac-a223-40c6f034906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:09.690855 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7afa7-1277-4bac-a223-40c6f034906a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:09.691349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7afa7-1277-4bac-a223-40c6f034906a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:09.691865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7afa7-1277-4bac-a223-40c6f034906a None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:09.692816 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7afa7-1277-4bac-a223-40c6f034906a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:09.694424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7afa7-1277-4bac-a223-40c6f034906a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:09.702113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 492/996] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:11:09 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:11:11.467098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af17db-e208-4824-b028-ec4ab314b586 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.467615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af17db-e208-4824-b028-ec4ab314b586 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.467692 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af17db-e208-4824-b028-ec4ab314b586 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.469035 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 505/997] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:11.474863 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.475281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.475464 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.492625 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:11.493803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:11.566124 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 493/998] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:11.589617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af17db-e208-4824-b028-ec4ab314b586 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:11.706631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af17db-e208-4824-b028-ec4ab314b586 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:11.722452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:11.747238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:11.748066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.748346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.748621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.749298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:11.750710 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-52edab1d-55fb-46e1-aa56-9de542004185 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:11.764394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:11.765821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:11.766651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 506/999] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:11:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:11.774004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:11.838483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642df2b-f2d0-4dde-b46e-63acd151dd84 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.838822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642df2b-f2d0-4dde-b46e-63acd151dd84 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.839065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642df2b-f2d0-4dde-b46e-63acd151dd84 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.840563 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 507/1000] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:11.845268 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41715653-da5e-41b0-900e-15e8050b1479 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.845749 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41715653-da5e-41b0-900e-15e8050b1479 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.846627 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41715653-da5e-41b0-900e-15e8050b1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.866032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-41715653-da5e-41b0-900e-15e8050b1479 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:11.867238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-41715653-da5e-41b0-900e-15e8050b1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:11.877826 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e2ccf-36de-462d-8ee3-2ef60e54e5eb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:11.902496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:11.916305 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:11.917396 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.917968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.918256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.919013 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:11.919496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:11.921264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5bcd-9961-43e3-9bb0-af4c675a2422 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:11.931366 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 494/1001] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:11.931366 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d6dd-6efd-4b3e-bc42-85cc58efff5a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.931366 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d6dd-6efd-4b3e-bc42-85cc58efff5a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.931366 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d6dd-6efd-4b3e-bc42-85cc58efff5a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.931366 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 495/1002] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:11.932429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d6dd-6efd-4b3e-bc42-85cc58efff5a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:11.941700 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 508/1003] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:11:11.943126 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:11.943410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:11.943683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:11.961245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:11.962672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:12.029011 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 509/1004] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:12.029837 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.040374 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d6dd-6efd-4b3e-bc42-85cc58efff5a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.072087 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:12.075499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.076246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.076540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.076824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.077523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:12.077821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.079287 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.084189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 496/1005] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:11:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:12.084981 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.136498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:12.138035 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192e54-6523-4c0f-b346-7103f3694013 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.172973 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.173757 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.174577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.174893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] PATH_INFO: `/v3/services/image` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.175551 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.176908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.183688 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7a90-dfe2-4344-8bf9-16abf5d7987e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:12.188307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:12.189363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:12.190270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 510/1006] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:11:12 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:12.191116 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.217266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.217985 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.218262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.218537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.219316 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.220671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:12.232757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:12.233910 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:12.235018 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 497/1007] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:12.235847 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.290835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb8e02-24fc-4921-9bd5-ccf9a29ade36 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.292349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:12.325131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.325780 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.326066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.326336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.327098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.328457 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.339002 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c5227-d3cb-4531-9df6-62a3c77dd829 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.342858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 511/1008] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:11:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:12.343653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.357714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:12.386157 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.386871 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.387162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.387445 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.388173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] RBAC: Adding query filter params (name=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:12.388484 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.389885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.395648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 498/1009] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:12.403225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.488235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1f968-7364-4fdc-8690-f6cc46d73173 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.526725 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.527421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.527699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.527975 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.528683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:12.528986 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.530346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.536350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 512/1010] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:12.538687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b71c-5b2f-461a-affc-b0940ef0aa25 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.542061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.573607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:12.576469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.577323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.577605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.577876 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.578592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] RBAC: Adding query filter params (type=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:12.579083 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.580942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.585912 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 499/1011] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:12.660908 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d0046-2e83-4df2-9e57-5cb5bf9ca440 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.698083 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.698764 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.699074 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.699353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.700077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:12.700385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.701802 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92ac4e-41c4-457d-a690-a10e8e2015fd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.712615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 513/1012] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:11:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:12.713960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:12.760771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:12.828978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5410b2-17ea-4365-9a26-820c18d2c460 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:12.863149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566aab-a80a-489a-80a5-c8abbac7bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:12.863888 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566aab-a80a-489a-80a5-c8abbac7bcdd None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:12.864172 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566aab-a80a-489a-80a5-c8abbac7bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:12.864443 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566aab-a80a-489a-80a5-c8abbac7bcdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:12.865181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f566aab-a80a-489a-80a5-c8abbac7bcdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:12.866544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f566aab-a80a-489a-80a5-c8abbac7bcdd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:12.886703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 500/1013] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:11:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:14.603528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b270de-1e95-48e1-badc-c54bbaa5914b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:14.604045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b270de-1e95-48e1-badc-c54bbaa5914b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:14.604045 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b270de-1e95-48e1-badc-c54bbaa5914b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:14.605567 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 514/1014] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:14.610638 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50e28-c892-4131-be85-3ddb96cbc0fa None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:14.611073 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50e28-c892-4131-be85-3ddb96cbc0fa None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:14.611232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50e28-c892-4131-be85-3ddb96cbc0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:14.628356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bdc50e28-c892-4131-be85-3ddb96cbc0fa None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:14.629532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bdc50e28-c892-4131-be85-3ddb96cbc0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:14.706957 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 501/1015] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:14.730483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b270de-1e95-48e1-badc-c54bbaa5914b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:14.826237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:14.838509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b270de-1e95-48e1-badc-c54bbaa5914b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:14.856424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e467-64a2-4ff2-98b1-43171f6a9c20 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:14.856710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e467-64a2-4ff2-98b1-43171f6a9c20 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:14.856991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e467-64a2-4ff2-98b1-43171f6a9c20 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:14.858500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 502/1016] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:14.863435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:14.863726 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:14.864009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:14.877001 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:14.877798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:14.878077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:14.878347 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:14.879572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:14.880989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:14.881476 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:14.887270 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 515/1017] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:14.887419 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:14.888789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:14.904377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:14.963517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 503/1018] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:11:14.985204 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:14.996624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995c202-94e6-405b-9d79-621bb08b2133 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:15.034844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f915c-2713-478b-b7f9-45c881dcbbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:15.035532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f915c-2713-478b-b7f9-45c881dcbbda None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.035821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f915c-2713-478b-b7f9-45c881dcbbda None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.036111 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f915c-2713-478b-b7f9-45c881dcbbda None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.036830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f915c-2713-478b-b7f9-45c881dcbbda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:15.038403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f915c-2713-478b-b7f9-45c881dcbbda None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:15.078833 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 516/1019] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:11:14 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:15.109926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b9d42-f32b-495e-8911-0cc882c2bd7a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:15.156316 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abc78-7b63-4e21-999a-06e1a19a81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:15.157012 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abc78-7b63-4e21-999a-06e1a19a81e4 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.157296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abc78-7b63-4e21-999a-06e1a19a81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.157573 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abc78-7b63-4e21-999a-06e1a19a81e4 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.158346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abc78-7b63-4e21-999a-06e1a19a81e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:15.159799 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abc78-7b63-4e21-999a-06e1a19a81e4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:15.181728 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 504/1020] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:11:14 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:11:15.221343 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7a4a4-c66d-4b33-a674-e74ff18c443b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.221525 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7a4a4-c66d-4b33-a674-e74ff18c443b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.221799 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7a4a4-c66d-4b33-a674-e74ff18c443b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.223321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 517/1021] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:15.229367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.229650 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.229924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.248679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:15.249953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:15.262782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:15.337491 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 505/1022] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:15.361337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7a4a4-c66d-4b33-a674-e74ff18c443b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:15.374547 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:15.475024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7a4a4-c66d-4b33-a674-e74ff18c443b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:15.508168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:15.508971 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.509245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.509509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.520402 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:15.528458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:15.529373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:15.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 518/1023] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:11:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:15.535995 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:15.643542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10016668-6499-4df6-928c-53cd2e4dda1f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:15.677942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:15.678621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.678935 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.679211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.679963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:15.680272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:15.681640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:15.686755 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:15.698495 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:15.699310 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 506/1024] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:11:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:15.771491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:15.804215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0abc26-ff53-47dd-8678-9fec92571386 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:15.838393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:15.839209 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:15.839490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:15.839760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:15.850352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:15.851800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:15.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:15.869373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:15.870250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:15.870250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:15.870250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:15.870250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:15.870250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 519/1025] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:15.876377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:15.979343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a56747-ef02-4e53-8589-3b5ce6753e84 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:16.013116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:16.013782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:16.014065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:16.014337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:16.015362 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:16.015669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:16.017035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:16.033749 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 507/1026] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:16.034968 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:16.134117 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e6ff6-cdb9-41d4-9454-be968443e808 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:16.156178 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:16.169159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:16.169942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:16.170224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:16.170497 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:16.178584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:16.180046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:11:16.194203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:16.195768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:16.196711 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 520/1027] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:11:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:16.202971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:16.266378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:16.308266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c22c9-e50a-43f7-80b7-dd762f90ce9b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:16.345305 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:16.346016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:16.346297 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:16.346570 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:16.347452 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:16.347763 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:16.349192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:16.371211 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 508/1028] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:11:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:16.372520 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:16.484236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37e3e-9ac8-42ce-bc4a-ff515be40c8a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:16.518099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:16.518741 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:16.519062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:16.519333 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:16.567137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:16.586139 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:16.587600 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:16.698553 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 521/1029] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:16.699852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:16.800096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb6628-bb7f-4b10-885f-70501700bd3c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:16.818158 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:16.836627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:16.837423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:16.837702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:16.837974 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:16.848049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:16.849493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:16.866646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:16.867787 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:16.868669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:16.868669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:16.868669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:16.868669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:16.868669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 509/1030] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:16.874571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:16.957075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:16.976065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4461-b279-4515-b965-120cb0437a26 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.010687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.011366 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.011647 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.011917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.012632 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:17.012935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.014282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.031521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 522/1031] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:17.032752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.138161 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02566b-b36a-41ee-8138-5e418d11be04 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.174291 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.175152 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.175441 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.175748 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.183713 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.185213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b1459bc5-f349-4ff3-b155-1bd37af73e91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:11:17.201634 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:17.202620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:17.203582 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:17.204662 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 510/1032] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:17.209258 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.315848 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930ca9d-f8c0-4d1e-bad7-fc650030af36 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.349755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.350412 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.350691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.351774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:17.352078 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.353485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.360228 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543332b-b3f0-49c1-a9b1-6a9efb626699 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.360530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543332b-b3f0-49c1-a9b1-6a9efb626699 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.360806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543332b-b3f0-49c1-a9b1-6a9efb626699 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.362222 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 511/1033] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:17.366302 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 523/1034] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:17.367457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4880-5d57-4fa0-89ba-30b82ebc6659 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.367814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4880-5d57-4fa0-89ba-30b82ebc6659 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.368162 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4880-5d57-4fa0-89ba-30b82ebc6659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.371704 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.374449 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:17.387671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a90a4880-5d57-4fa0-89ba-30b82ebc6659 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:17.388927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a90a4880-5d57-4fa0-89ba-30b82ebc6659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:17.416578 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:17.460734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 512/1035] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:17.462055 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a880-bf28-4d05-b03d-a4abd02efc9d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.462345 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a880-bf28-4d05-b03d-a4abd02efc9d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.462835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a880-bf28-4d05-b03d-a4abd02efc9d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.464043 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 513/1036] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:17.472586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.473168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.473684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.478381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b81f38-eb59-4a89-9a8f-a04100178c53 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.491084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:17.492280 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:17.512076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.512736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.513021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.513297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.514127 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] RBAC: Adding query filter params (role.id=3d58e3fa240346389e971da8c3630182, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=ff0e8e8eafa44aa294538c43527190d8) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:17.514442 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.516163 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.521547 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 524/1037] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/role_assignments?user.id=ff0e8e8eafa44aa294538c43527190d8&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=3d58e3fa240346389e971da8c3630182 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:17.523643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.565415 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 514/1038] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:17.587950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.599349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:17.643631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77a9e-1adb-4327-a206-52c97dcddd2e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.680570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.681367 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.681643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.681909 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.683159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.684612 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.691228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 525/1039] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:17.692000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.694041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:17.707207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cafe68-cac2-445a-8b0a-3fbeb87a94ce None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.747235 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.748033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.748319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.748595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] PATH_INFO: `/v3/services/image` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.749261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.750637 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:17.762410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:17.763460 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:17.764295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 515/1040] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:17.770339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:17.812331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083bb1c-f9fb-4a50-88bb-73bc155ea131 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.849319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.849970 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.850253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.850532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.851279 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.852709 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.859865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:17.884837 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 526/1041] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:11:17 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:17.899300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56914-5d63-4f12-ab25-a9b66948ab39 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:17.930404 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:17.931142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:17.931422 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:17.931692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:17.932414 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] RBAC: Adding query filter params (name=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:17.932715 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:17.934113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:17.939780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 516/1042] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:17.945727 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:18.057809 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d896c-9f67-4054-9cf7-9350a821c6d2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:18.097219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:18.097891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:18.098175 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:18.098452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:18.099205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] RBAC: Adding query filter params (type=image) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:18.099532 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:18.100880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:18.106261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 527/1043] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:18.113377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:18.134113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:18.223535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f04c-f11f-4690-8482-be512fbd47bb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:18.259448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:18.260112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:18.260397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:18.260675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:18.261472 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] RBAC: Adding query filter params (interface=public, service_id=2457c169e5104aee83322eb6fab63adf, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:18.261786 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:18.263177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980afe7-b2d9-417f-a77c-9d76910590ae None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:18.269393 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 517/1044] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:11:18 2022] GET /identity/v3/endpoints?service_id=2457c169e5104aee83322eb6fab63adf&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:18.275151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:18.333288 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:18.381134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f104-6412-47f3-bd66-403461d5bd35 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:18.422295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b20f9-242d-4762-b586-035e368a4e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:18.422998 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b20f9-242d-4762-b586-035e368a4e66 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:18.423278 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b20f9-242d-4762-b586-035e368a4e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:18.424085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b20f9-242d-4762-b586-035e368a4e66 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:18.424765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b20f9-242d-4762-b586-035e368a4e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:18.426114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b20f9-242d-4762-b586-035e368a4e66 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:18.438826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 528/1045] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:11:18 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:11:19.718703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb1cf7-fcc4-4b7b-b5f1-d0408dd4dc10 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:19.719255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb1cf7-fcc4-4b7b-b5f1-d0408dd4dc10 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:19.719255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb1cf7-fcc4-4b7b-b5f1-d0408dd4dc10 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:19.721340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 518/1046] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:19.726482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:19.726906 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:19.727065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:19.744065 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:19.745226 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:19.813901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 529/1047] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:19.836355 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb1cf7-fcc4-4b7b-b5f1-d0408dd4dc10 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:19.922191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:19.942993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb1cf7-fcc4-4b7b-b5f1-d0408dd4dc10 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:19.979369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:19.980105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:19.980382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:19.980651 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:19.990696 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:19.998808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:19.999734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:20.000608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:20.003135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 519/1048] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:11:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:20.006215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.061317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.117137 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1680444-6f41-4b96-8323-d87f7fe04109 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.176533 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.177298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.177580 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.177853 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.178611 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:20.178952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.180327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838da7f8-eb00-48b8-887f-e7c201605d4b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.193641 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 530/1049] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:20.195522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.207447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840731c-adcb-47c2-b907-61c1e9975441 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.207736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840731c-adcb-47c2-b907-61c1e9975441 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.208010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840731c-adcb-47c2-b907-61c1e9975441 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.209584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 531/1050] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:20.214331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.214773 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.215074 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.232286 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:20.233382 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:20.301494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 532/1051] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:11:20.305461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842b06-fcd1-45e8-b639-6f11f719fe17 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.324238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.340119 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.340913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.341193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.341461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.352666 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.354113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.355963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.370691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:20.372674 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:20.378359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:20.379516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:20.379516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:20.379516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:20.379516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:20.379516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 520/1052] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:20.381237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.448845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee76a8-d47a-4b41-8301-5f57c36dea1c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.491322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.492057 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.492334 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.492606 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.505160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:20.509898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee0f4-f801-4107-ba07-e276413fe144 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:20.512969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:20.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:20.515252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:20.519554 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 533/1053] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:20.520220 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.550754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.551563 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.551940 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.552217 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.552949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:20.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.554619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.567967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 521/1054] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:20.573367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.630775 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.634381 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.635023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a970-94d2-44f9-8b37-97d0f21f0d2b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.671578 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.672275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.672550 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.672822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.674129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:20.674427 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.675819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6424d-f39f-4729-95e7-583f74237948 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.682289 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168c8fe-3571-469c-8e69-defd7ae699d5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.683869 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 534/1055] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:20.685069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6ab2-1590-4c80-8d85-042f29b3cbde None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.685353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6ab2-1590-4c80-8d85-042f29b3cbde None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.685624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6ab2-1590-4c80-8d85-042f29b3cbde None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.686843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 535/1056] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:20.690980 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6ab2-1590-4c80-8d85-042f29b3cbde None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.718774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.719584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.719864 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.720142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.727723 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.729145 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1b8a41c8-0103-4045-943c-85493a4ce217 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:11:20.743377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:20.744401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:20.745636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 522/1057] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:20.746245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.746245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.746506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.762061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:20.763275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:20.793767 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6ab2-1590-4c80-8d85-042f29b3cbde None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.826352 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.827235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.827510 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.827777 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] PATH_INFO: `/v3/users/0b2fa87d29ab43a59efaa2df35f52740` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.828993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 523/1058] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:20.830360 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.842152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] RBAC: Authorizing `identity:get_user(user_id=0b2fa87d29ab43a59efaa2df35f52740)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.843602 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.846960 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 536/1059] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/users/0b2fa87d29ab43a59efaa2df35f52740 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:20.852014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:20.872287 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.877879 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:20.932742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adc177-610f-456b-ae96-94abc2b3c531 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.949726 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0fd8-2fe8-4a38-8c4f-964d0eee1c5d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:20.965727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.966388 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.966673 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.966980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.967810 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:20.968117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:20.969535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:20.984409 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:20.985124 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:20.985410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:20.985684 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:20.986474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 524/1060] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:20.987302 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.052053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.053396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.074348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.090070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f78b09-d4d2-4cb9-864f-c83771a65373 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.091640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.123921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.124703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.124994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.125271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] PATH_INFO: `/v3/services/image` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.125928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.128292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:21.140232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:21.141405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:21.143131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 525/1061] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:21.145468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.153448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 537/1062] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:11:21.154276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.248882 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c578-676b-4542-b885-6fec5b0fcc60 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.250454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb450-1226-4eb6-bcac-178aa657f61f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.271918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.283049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.283841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.284125 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.284402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.286088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.286738 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.287039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.287308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.288037 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:21.288337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.289686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.294857 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.294963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 538/1063] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:21.295705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.296448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:21.315792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:21.316868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:21.317885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:21.317885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:21.317885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:21.317885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:21.317885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 526/1064] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:21.317885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.338804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.395652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bf2d-908e-4f2f-bd47-19d2621f68a5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.423954 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b44c6-eeec-4700-b8c9-c42080a307a9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.430079 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.430979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.431265 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.431546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.432722 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] RBAC: Authorizing `identity:get_project(project_id=eeefb8b69e8741b59bfecf86cb3a72bd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.434151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.442349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 539/1065] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:21.442349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.463678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.464344 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.464629 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.464905 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.465648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] RBAC: Adding query filter params (type=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:21.465964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.467384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.472149 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 527/1066] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:21.472924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.493963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.556315 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545b5d-d489-4245-a0ad-0a71bb9175e7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.562820 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.581763 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac551bf-ebfd-4a46-98dc-ee0372d296da None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.589635 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.590295 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.590571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.590867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.591582 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:21.591884 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.593232 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.604473 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 540/1067] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:21.605396 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.616642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.617299 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.617583 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.617859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.618687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd, user.id=0b2fa87d29ab43a59efaa2df35f52740) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:21.619025 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.620452 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.635378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 528/1068] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/role_assignments?user.id=0b2fa87d29ab43a59efaa2df35f52740&scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:21.635378 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.724788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c94a-1017-4661-8e93-4ce0f31610d9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.744167 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:21.749417 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf73b6-6fbd-45b3-be1a-413ad1752e43 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.769848 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.770608 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.770920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.771196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.771955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.773340 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.788331 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.789474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.789771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.790128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.794082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 541/1069] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:11:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:21.798047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.800151 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:11:21.817017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:21.818191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:21.819195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 529/1070] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:21.827955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:21.953020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583e01-ce36-4e7b-893d-fa661c743bc2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:21.990245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:21.990951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:21.991236 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:21.991509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:21.992301 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:21.992613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:21.994036 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24ce0-5175-487d-879b-ce8989e78882 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:22.006826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 542/1071] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:22.012906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:22.022964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:22.119642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad0397-a594-464d-9ffc-9bab22dcfe22 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:22.174232 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59dbbf-3ae7-4c70-a18d-9ef4ea20832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:22.175175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dbbf-3ae7-4c70-a18d-9ef4ea20832a None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:22.175461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dbbf-3ae7-4c70-a18d-9ef4ea20832a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:22.175734 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dbbf-3ae7-4c70-a18d-9ef4ea20832a None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/ff0e8e8eafa44aa294538c43527190d8/roles/3d58e3fa240346389e971da8c3630182` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:22.178271 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59dbbf-3ae7-4c70-a18d-9ef4ea20832a None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=ff0e8e8eafa44aa294538c43527190d8, role_id=3d58e3fa240346389e971da8c3630182)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:22.180391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59dbbf-3ae7-4c70-a18d-9ef4ea20832a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:22.199120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 530/1072] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:11:22 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/ff0e8e8eafa44aa294538c43527190d8/roles/3d58e3fa240346389e971da8c3630182 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:11:23.889235 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4970e9-d44e-4d88-b733-dfa103ada98f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:23.890066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4970e9-d44e-4d88-b733-dfa103ada98f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:23.890066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4970e9-d44e-4d88-b733-dfa103ada98f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:23.891546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 543/1073] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:23.897895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aadd4e-5fbc-4169-8f25-b9f82f169ef7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:23.898420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aadd4e-5fbc-4169-8f25-b9f82f169ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:23.898495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aadd4e-5fbc-4169-8f25-b9f82f169ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:23.916566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d0aadd4e-5fbc-4169-8f25-b9f82f169ef7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:23.917769 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d0aadd4e-5fbc-4169-8f25-b9f82f169ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:23.980371 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:23.991325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 531/1074] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:24.013570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4970e9-d44e-4d88-b733-dfa103ada98f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.042392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.066950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615699c-fe56-4691-8230-544756c2084b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.067281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615699c-fe56-4691-8230-544756c2084b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.067513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615699c-fe56-4691-8230-544756c2084b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.069036 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 532/1075] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:11:24.073800 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.074085 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.074358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.091255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:24.092433 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:24.127719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4970e9-d44e-4d88-b733-dfa103ada98f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.161937 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 533/1076] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:24.164095 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.164897 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.165183 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.165460 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.176251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:24.183804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:24.184733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:24.185581 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:24.186236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.189901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 544/1077] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:24.190629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.284174 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.298837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf167-ec18-45b5-99ad-9640cf61e313 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.305005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6c1a-19fa-49c0-a05e-76a364901a8f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.329309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.340873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c9eab-cc51-4861-bdb1-66a7b5994808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.341549 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c9eab-cc51-4861-bdb1-66a7b5994808 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.341846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c9eab-cc51-4861-bdb1-66a7b5994808 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.342114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c9eab-cc51-4861-bdb1-66a7b5994808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.348678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.349677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.350162 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.350648 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.351700 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:24.352215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.353922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.363554 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 545/1078] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:24.369198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.427351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c9eab-cc51-4861-bdb1-66a7b5994808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.429364 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c9eab-cc51-4861-bdb1-66a7b5994808 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.471804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef123aca-0732-452d-9588-1136ae73977c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.505358 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97642-7ada-4ac5-85d5-777227c40372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.506231 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97642-7ada-4ac5-85d5-777227c40372 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.506508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97642-7ada-4ac5-85d5-777227c40372 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.506780 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97642-7ada-4ac5-85d5-777227c40372 None admin] PATH_INFO: `/v3/users/0b2fa87d29ab43a59efaa2df35f52740` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.508021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97642-7ada-4ac5-85d5-777227c40372 None admin] RBAC: Authorizing `identity:get_user(user_id=0b2fa87d29ab43a59efaa2df35f52740)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.509448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97642-7ada-4ac5-85d5-777227c40372 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.511113 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 546/1079] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/users/0b2fa87d29ab43a59efaa2df35f52740 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:24.512290 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b57d4-fb23-427b-bd02-0187a5a80962 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.512576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b57d4-fb23-427b-bd02-0187a5a80962 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.512852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b57d4-fb23-427b-bd02-0187a5a80962 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.514154 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 547/1080] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:24.517734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b57d4-fb23-427b-bd02-0187a5a80962 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.533014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.535406 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 534/1081] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:11:24.536703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.536991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.537262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.554128 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:24.555338 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:24.575960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.622077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 535/1082] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:24.622929 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.625373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b57d4-fb23-427b-bd02-0187a5a80962 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.659848 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.660709 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.661073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.661350 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.662517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] RBAC: Authorizing `identity:get_project(project_id=eeefb8b69e8741b59bfecf86cb3a72bd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.663966 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.665663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 548/1083] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:24.666417 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.721019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164b52f-d76b-466a-ace4-3a497a32b8fe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.749734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.756640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.757833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.758117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.758389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.768619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.769168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee356-e901-4ef6-b5f7-dfe3b611c12a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.770064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:24.788684 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:24.789585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:24.790510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:24.790510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:24.790510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:24.790510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:24.790510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 536/1084] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:24.790842 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.801392 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:24.808574 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.809376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.809652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.809931 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.820386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:24.828383 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:24.829636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 549/1085] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:24.831429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.890037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbffb5-e65a-4ad8-ba31-26691cddd1de None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.925467 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.927092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.927376 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.927648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd/users/0b2fa87d29ab43a59efaa2df35f52740/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.929617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeefb8b69e8741b59bfecf86cb3a72bd, user_id=0b2fa87d29ab43a59efaa2df35f52740, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.931073 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.932768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea9ea1-4560-40ca-a2cf-abf448392413 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:24.945789 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 537/1086] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:11:24 2022] PUT /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd/users/0b2fa87d29ab43a59efaa2df35f52740/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:11:24.946814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:24.969856 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:24.971170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:24.971384 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:24.971654 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:24.972398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:24.972705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:24.974207 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:24.998822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 550/1087] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:25.035339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:25.078006 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426fdde-3c67-4577-9f28-a33cbd1ccf49 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:25.119158 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:25.119862 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:25.120144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:25.120418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:25.121192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:25.121499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:25.122964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:25.137565 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 538/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:11:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:25.139067 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:25.142435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:25.252128 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651252e7-7fcb-4936-9f5d-fee3c8c8481a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:25.291141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:25.293372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:25.293372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:25.293372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:25.302871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:25.304311 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:25.322668 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:25.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:25.324922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:25.324922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:25.324922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:25.324922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:25.324922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 551/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:25.330448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:25.431219 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38f553-7ba2-49fe-82ee-856bb6ef7447 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:25.458868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:25.464883 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:25.465544 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:25.465824 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:25.466095 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:25.466835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:25.467139 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:25.468499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:25.481293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 539/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:25.486901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:25.541835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:25.585820 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea8413-382b-4896-a46d-08430d06d316 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:25.617898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:25.618692 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:25.618996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:25.619266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:25.626673 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:25.628210 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:11:25.643336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:25.644479 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:25.645475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 552/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:11:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:25.650382 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:25.749107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b2dff-8f38-443c-b4a5-701087271e2c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:25.783564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:25.784250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:25.784534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:25.784814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:25.785659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:25.785972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:25.787464 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:25.804631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 540/1092] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:11:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:11:25.810078 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:25.907893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6710d-ec25-48f7-91de-818cf2543e3a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:25.921353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:25.942110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:25.942752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:25.943059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:25.943336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:26.008365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:26.009800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:26.108146 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 553/1093] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:26.113649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:26.164402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:26.215373 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cbbbc-b8aa-4604-b8ac-ca4614c9bfe6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:26.249996 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:26.250812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:26.251100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:26.251435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:26.261826 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:26.263296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:26.281774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:26.282838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:26.283775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:11:26.283775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:26.283775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:11:26.283775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:26.283775 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 541/1094] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:26.288653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:26.303995 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:26.385845 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9bd01-67d0-426f-8409-504106d36c19 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:26.422767 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:26.424061 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:26.424341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:26.424613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:26.425329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:26.425630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:26.427017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:26.437924 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 554/1095] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:26.443549 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:26.538198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:26.541110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053a3c-c100-48ac-9cff-e5e8cff2d7d9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:26.575311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:26.576097 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:26.576380 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:26.576652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:26.583737 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:26.585169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:11:26.598558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:26.599595 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:26.600645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 542/1096] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:11:26.605663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:26.681470 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:26.706443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc3d8f-a41e-4959-9955-9441b68498a4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:26.739298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:26.739955 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:26.740234 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:26.740508 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:26.741290 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:26.741595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:26.743044 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f4a34-e9f4-417c-a8d5-9bf6a2176742 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:26.759789 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 555/1097] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:26.761270 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:26.860898 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841eac0-2a6b-4e0b-88df-69f9e5dd0eeb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:26.894807 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:26.895816 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:26.896108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:26.896387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:26.897221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] RBAC: Adding query filter params (role.id=3d58e3fa240346389e971da8c3630182, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=ff0e8e8eafa44aa294538c43527190d8) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:26.897534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:26.898982 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee2790-ca54-4bca-bd04-3e3a288a1391 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:26.904720 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 543/1098] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:26 2022] GET /identity/v3/role_assignments?user.id=ff0e8e8eafa44aa294538c43527190d8&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=3d58e3fa240346389e971da8c3630182 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:27.217092 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218cceb-c4b5-4d2f-abcc-a5184f046904 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:27.217611 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218cceb-c4b5-4d2f-abcc-a5184f046904 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:27.217699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218cceb-c4b5-4d2f-abcc-a5184f046904 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:27.219080 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 556/1099] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:27.224611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:27.225056 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:27.225154 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:27.243395 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:27.244586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:27.263295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:27.318819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 544/1100] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:27.342708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218cceb-c4b5-4d2f-abcc-a5184f046904 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:27.446585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218cceb-c4b5-4d2f-abcc-a5184f046904 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:27.481735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:27.482461 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:27.482736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:27.483048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:27.484901 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:27.494585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:27.502697 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:27.503746 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:27.504592 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 557/1101] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:11:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:27.510180 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:27.614036 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9f2c-31e7-4140-ba16-74d0a3271e84 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:27.648935 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:27.649614 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:27.649893 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:27.650169 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:27.650950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:27.651262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:27.652631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:27.661663 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 545/1102] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:27.667515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:27.773196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590aac9-fa8c-45af-9d71-3be5c06c06cc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:27.807621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:27.808491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:27.808774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:27.809049 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] PATH_INFO: `/v3/users/0b2fa87d29ab43a59efaa2df35f52740` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:27.810218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] RBAC: Authorizing `identity:get_user(user_id=0b2fa87d29ab43a59efaa2df35f52740)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:27.811691 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:27.813326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 558/1103] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:27 2022] GET /identity/v3/users/0b2fa87d29ab43a59efaa2df35f52740 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:27.819710 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:27.838537 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:27.921994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89c137-5cae-4cad-9a51-a5e36db2450f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:27.954435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:27.955105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:27.955388 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:27.955661 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:28.022399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:28.023950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:28.040361 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:28.119076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 546/1104] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:28.124918 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:28.185346 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:28.223487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a72f1-f310-4a8f-82cd-a9f253cae860 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:28.255538 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4393-8870-456c-89fa-4c3d6c19c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:28.256384 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4393-8870-456c-89fa-4c3d6c19c200 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:28.256666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4393-8870-456c-89fa-4c3d6c19c200 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:28.256942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4393-8870-456c-89fa-4c3d6c19c200 None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:28.258100 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4393-8870-456c-89fa-4c3d6c19c200 None admin] RBAC: Authorizing `identity:get_project(project_id=eeefb8b69e8741b59bfecf86cb3a72bd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:28.259544 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4393-8870-456c-89fa-4c3d6c19c200 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:28.261234 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 559/1105] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:28 2022] GET /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:28.267968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:28.367519 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d42494-7830-4fb2-8b3c-6b6c719747f3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:28.383850 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:28.401834 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:28.402490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:28.402771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:28.403070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:28.403908 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd, user.id=0b2fa87d29ab43a59efaa2df35f52740) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:28.404221 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:28.405653 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b29e2-ff7d-4f7f-a8ea-7f439c6692ce None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:28.411532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 547/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:28 2022] GET /identity/v3/role_assignments?user.id=0b2fa87d29ab43a59efaa2df35f52740&scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:30.645292 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175d40-b572-48a5-99a1-e524d6a4f387 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:30.645847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175d40-b572-48a5-99a1-e524d6a4f387 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:30.645847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175d40-b572-48a5-99a1-e524d6a4f387 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:30.647251 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 560/1107] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:30.652521 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:30.652928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:30.653086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:30.670131 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:30.671291 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:30.735587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 548/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:30.759444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175d40-b572-48a5-99a1-e524d6a4f387 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:30.857329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175d40-b572-48a5-99a1-e524d6a4f387 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:30.884705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:30.891158 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d4547-f299-4de1-8f89-37d4cd2b1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:30.892514 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d4547-f299-4de1-8f89-37d4cd2b1a0c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:30.892795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d4547-f299-4de1-8f89-37d4cd2b1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:30.893070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d4547-f299-4de1-8f89-37d4cd2b1a0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:30.894239 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d4547-f299-4de1-8f89-37d4cd2b1a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:30.895694 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d4547-f299-4de1-8f89-37d4cd2b1a0c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:30.897308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 561/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:30.902951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:30.999371 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ff8e-e643-4624-b0e5-0bbc48ac9317 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:31.010065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:31.033577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaf6e1-929f-466d-bf1e-9e1b4fc93c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:31.034241 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaf6e1-929f-466d-bf1e-9e1b4fc93c58 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:31.034523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaf6e1-929f-466d-bf1e-9e1b4fc93c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:31.034813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaf6e1-929f-466d-bf1e-9e1b4fc93c58 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:31.035534 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaf6e1-929f-466d-bf1e-9e1b4fc93c58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:31.036958 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaf6e1-929f-466d-bf1e-9e1b4fc93c58 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:31.055911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 549/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:11:30 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:33.283434 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc706-c42c-4f5f-aa6c-6a5523ac9fa5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:33.284010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc706-c42c-4f5f-aa6c-6a5523ac9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:33.284010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc706-c42c-4f5f-aa6c-6a5523ac9fa5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:33.285327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 562/1111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:33.290586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:33.291010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:33.291171 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:33.308064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:33.309238 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:33.372702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 550/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:33.395681 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc706-c42c-4f5f-aa6c-6a5523ac9fa5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:33.493917 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc706-c42c-4f5f-aa6c-6a5523ac9fa5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:33.536714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:33.537484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:33.537762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:33.538032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] PATH_INFO: `/v3/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:33.539521 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] RBAC: Authorizing `identity:get_role(role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:33.540895 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:33.542262 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 563/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:33 2022] GET /identity/v3/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:33.548066 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:33.638196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:33.645318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea612fb-3b80-4884-b6ed-e67fbd3f3076 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:33.678503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:33.679377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:33.679656 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:33.679924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] PATH_INFO: `/v3/users/47027d547495490bb604a12aeed39b13` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:33.692611 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] RBAC: Authorizing `identity:get_user(user_id=47027d547495490bb604a12aeed39b13)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:33.694078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:33.695793 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 551/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:33 2022] GET /identity/v3/users/47027d547495490bb604a12aeed39b13 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:33.704320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:33.768394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:33.801969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394d88f-b713-45b9-a324-1935685f9a48 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:33.835632 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:33.836275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:33.836555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:33.836832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:33.901575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:33.903029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:33.963492 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:33.999003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 564/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:34.005429 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:34.113259 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb48ee-aa5c-4f25-834b-7e28f45fce31 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:34.146939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf487-4c71-4c6d-83eb-bb1e23168a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:34.147792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf487-4c71-4c6d-83eb-bb1e23168a40 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:34.148075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf487-4c71-4c6d-83eb-bb1e23168a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:34.148351 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf487-4c71-4c6d-83eb-bb1e23168a40 None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:34.149519 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf487-4c71-4c6d-83eb-bb1e23168a40 None admin] RBAC: Authorizing `identity:get_project(project_id=eeefb8b69e8741b59bfecf86cb3a72bd)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:34.150987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf487-4c71-4c6d-83eb-bb1e23168a40 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:34.152691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 552/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:34 2022] GET /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:34.158935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:34.254589 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3cc0-a36b-446a-9997-5757358b9864 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:34.286667 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:34.287338 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:34.287619 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:34.287893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:34.288709 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] RBAC: Adding query filter params (role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd, user.id=47027d547495490bb604a12aeed39b13) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:34.289022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:34.290422 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183801a8-512b-4437-ac4e-5628be976938 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:34.295770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 565/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:34 2022] GET /identity/v3/role_assignments?user.id=47027d547495490bb604a12aeed39b13&scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:36.479862 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8c88-ae8d-4952-836e-b85e73379d49 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:36.480346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8c88-ae8d-4952-836e-b85e73379d49 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:36.480435 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8c88-ae8d-4952-836e-b85e73379d49 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:36.481770 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 553/1118] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:36.487014 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:36.487429 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:36.487562 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:36.503854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:36.505022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:36.528326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:36.570227 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 566/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:36.592992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd8c88-ae8d-4952-836e-b85e73379d49 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:36.618673 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:36.695214 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd8c88-ae8d-4952-836e-b85e73379d49 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:36.728118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:36.728964 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:36.729244 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:36.729512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] PATH_INFO: `/v3/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:36.730985 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] RBAC: Authorizing `identity:get_role(role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:36.732343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:36.733693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 554/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:36 2022] GET /identity/v3/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:36.739492 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:36.836575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b825f8a-c28c-4f80-abb7-05c48678b24c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:36.868832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:36.869679 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:36.869957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:36.870224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] PATH_INFO: `/v3/users/47027d547495490bb604a12aeed39b13` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:36.871399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=47027d547495490bb604a12aeed39b13)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:36.872801 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:36.874393 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 567/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:36 2022] GET /identity/v3/users/47027d547495490bb604a12aeed39b13 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:36.880405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:36.967292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:36.976984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587e1d0-b202-474b-b55d-be264bed150b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:37.009576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f948aa5-907c-4231-8f98-5490b37085bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:37.010416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f948aa5-907c-4231-8f98-5490b37085bc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:37.010694 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f948aa5-907c-4231-8f98-5490b37085bc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:37.010983 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f948aa5-907c-4231-8f98-5490b37085bc None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:37.012135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f948aa5-907c-4231-8f98-5490b37085bc None admin] RBAC: Authorizing `identity:get_project(project_id=eeefb8b69e8741b59bfecf86cb3a72bd)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:37.013550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f948aa5-907c-4231-8f98-5490b37085bc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:37.015498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 555/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:36 2022] GET /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:37.021327 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:37.049645 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:37.120271 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66abefa-3393-445e-a4e5-7b6a9a89e7d6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:37.153784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c56a61-f38a-4bc0-8e2d-d5e45e2e178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:37.154652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c56a61-f38a-4bc0-8e2d-d5e45e2e178f None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:37.154959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c56a61-f38a-4bc0-8e2d-d5e45e2e178f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:37.155232 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c56a61-f38a-4bc0-8e2d-d5e45e2e178f None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd/users/47027d547495490bb604a12aeed39b13/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:37.157417 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c56a61-f38a-4bc0-8e2d-d5e45e2e178f None admin] RBAC: Authorizing `identity:create_grant(project_id=eeefb8b69e8741b59bfecf86cb3a72bd, user_id=47027d547495490bb604a12aeed39b13, role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:37.158852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c56a61-f38a-4bc0-8e2d-d5e45e2e178f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:37.171256 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 568/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:11:37 2022] PUT /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd/users/47027d547495490bb604a12aeed39b13/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:11:39.381788 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023801d-0938-4117-92ec-496c35e48be3 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:39.382320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023801d-0938-4117-92ec-496c35e48be3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:39.382320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023801d-0938-4117-92ec-496c35e48be3 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:39.383724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 556/1124] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:39.389122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:39.389494 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:39.389677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:39.407032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:39.408194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:39.472665 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 569/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:39.495272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023801d-0938-4117-92ec-496c35e48be3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:39.593284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023801d-0938-4117-92ec-496c35e48be3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:39.625839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:39.626678 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:39.626979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:39.627250 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] PATH_INFO: `/v3/roles/f087e968e7ab4ea3bfc69cf0acf4ac15` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:39.628691 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] RBAC: Authorizing `identity:get_role(role_id=f087e968e7ab4ea3bfc69cf0acf4ac15)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:39.630051 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:39.631498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 557/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:39 2022] GET /identity/v3/roles/f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:39.637180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:39.655736 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:39.735949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cba2-f2d6-4993-9b7c-d07b5072275f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:39.769253 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:39.770112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:39.770390 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:39.770661 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] PATH_INFO: `/v3/users/47027d547495490bb604a12aeed39b13` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:39.771868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] RBAC: Authorizing `identity:get_user(user_id=47027d547495490bb604a12aeed39b13)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:39.773289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:39.774919 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 570/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:39 2022] GET /identity/v3/users/47027d547495490bb604a12aeed39b13 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:39.780520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:39.807469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:39.880653 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09caa35-ff26-4af9-a51a-adeed37b63dd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:39.916019 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:39.916627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:39.916913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:39.917188 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:39.981446 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:39.982930 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:40.007850 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:40.079293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 558/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:40.085076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:40.167613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:40.182895 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0893f-34fc-49aa-ab5a-a140e3abb60d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:40.215458 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdad91-526d-45a9-b4bb-583711cdf4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:40.216299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdad91-526d-45a9-b4bb-583711cdf4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:40.216577 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdad91-526d-45a9-b4bb-583711cdf4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:40.216848 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdad91-526d-45a9-b4bb-583711cdf4e7 None admin] PATH_INFO: `/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:40.218003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdad91-526d-45a9-b4bb-583711cdf4e7 None admin] RBAC: Authorizing `identity:get_project(project_id=eeefb8b69e8741b59bfecf86cb3a72bd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:40.219450 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdad91-526d-45a9-b4bb-583711cdf4e7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:40.221123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 571/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:40 2022] GET /identity/v3/projects/eeefb8b69e8741b59bfecf86cb3a72bd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:40.227084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:40.322924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b486b2-9b0e-4657-8ae6-2b2b9096dd9b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:40.347192 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:40.356016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7867862-64af-4705-9370-dae29499c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:40.356660 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7867862-64af-4705-9370-dae29499c546 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:40.356941 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7867862-64af-4705-9370-dae29499c546 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:40.357215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7867862-64af-4705-9370-dae29499c546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:40.358040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7867862-64af-4705-9370-dae29499c546 None admin] RBAC: Adding query filter params (role.id=f087e968e7ab4ea3bfc69cf0acf4ac15, scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd, user.id=47027d547495490bb604a12aeed39b13) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:40.358349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7867862-64af-4705-9370-dae29499c546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:40.360337 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7867862-64af-4705-9370-dae29499c546 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:40.366010 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 559/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:40 2022] GET /identity/v3/role_assignments?user.id=47027d547495490bb604a12aeed39b13&scope.project.id=eeefb8b69e8741b59bfecf86cb3a72bd&role.id=f087e968e7ab4ea3bfc69cf0acf4ac15 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:42.558473 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6fc7-0d57-4613-94d1-4a0c4f77ed28 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:42.559039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6fc7-0d57-4613-94d1-4a0c4f77ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:42.559039 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6fc7-0d57-4613-94d1-4a0c4f77ed28 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:42.560401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 572/1131] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:42.566206 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:42.566605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:42.566754 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:42.583597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:42.584758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:42.648516 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 560/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:42.672041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6fc7-0d57-4613-94d1-4a0c4f77ed28 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:42.770097 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6fc7-0d57-4613-94d1-4a0c4f77ed28 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:42.802284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3da40-228b-4608-81f9-9578eaa11d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:42.803075 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3da40-228b-4608-81f9-9578eaa11d59 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:42.803353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3da40-228b-4608-81f9-9578eaa11d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:42.803622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3da40-228b-4608-81f9-9578eaa11d59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:42.804763 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3da40-228b-4608-81f9-9578eaa11d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:42.806168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3da40-228b-4608-81f9-9578eaa11d59 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:42.807765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 573/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:42.814037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:42.910756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76437f42-3f28-4165-96e5-2f8d0da55140 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:42.930561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:42.944546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446413a-4902-4791-9b89-852e5efe5410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:42.945202 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446413a-4902-4791-9b89-852e5efe5410 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:42.945485 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446413a-4902-4791-9b89-852e5efe5410 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:42.945761 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446413a-4902-4791-9b89-852e5efe5410 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:42.946462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446413a-4902-4791-9b89-852e5efe5410 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:42.947919 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446413a-4902-4791-9b89-852e5efe5410 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:42.972482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 561/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:11:42 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:45.205739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcda44-d333-4c3d-8ff2-34a2c5e7e60d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:45.206269 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcda44-d333-4c3d-8ff2-34a2c5e7e60d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:45.206387 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcda44-d333-4c3d-8ff2-34a2c5e7e60d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:45.207757 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 574/1135] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:45.213216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:45.213612 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:45.213779 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:45.230282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:45.231503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:45.297448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 562/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:45.322066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcda44-d333-4c3d-8ff2-34a2c5e7e60d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:45.346135 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:45.421379 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcda44-d333-4c3d-8ff2-34a2c5e7e60d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:45.455032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02db46f-5d12-4c3c-866f-3056daabf88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:45.455858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02db46f-5d12-4c3c-866f-3056daabf88a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:45.456089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02db46f-5d12-4c3c-866f-3056daabf88a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:45.456361 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02db46f-5d12-4c3c-866f-3056daabf88a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:45.457519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02db46f-5d12-4c3c-866f-3056daabf88a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:45.458962 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02db46f-5d12-4c3c-866f-3056daabf88a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:45.460560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 575/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:45.466183 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:45.562303 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd419b41-2937-40bf-9061-4211bdeb2028 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:45.563833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:45.597479 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c550e3a-01d6-4722-b78a-82d58ad1853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:45.598142 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550e3a-01d6-4722-b78a-82d58ad1853b None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:45.598428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550e3a-01d6-4722-b78a-82d58ad1853b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:45.598702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550e3a-01d6-4722-b78a-82d58ad1853b None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:45.599448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c550e3a-01d6-4722-b78a-82d58ad1853b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:45.600899 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c550e3a-01d6-4722-b78a-82d58ad1853b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:45.620226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 563/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:11:45 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:11:47.840765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8325-29b2-4106-8fb3-c569cd665e7d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:47.841298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8325-29b2-4106-8fb3-c569cd665e7d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:47.841298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8325-29b2-4106-8fb3-c569cd665e7d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:47.842678 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 576/1139] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:47.848668 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:47.849046 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:47.849229 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:47.865704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:47.866950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:47.931927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 564/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:47.955498 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8325-29b2-4106-8fb3-c569cd665e7d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:48.044628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:48.055401 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8325-29b2-4106-8fb3-c569cd665e7d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:48.088317 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:48.089086 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:48.089363 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:48.089631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:48.099291 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:48.107455 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:48.108524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:48.109368 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 577/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:48.114687 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:48.201190 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:48.214559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149c49e-1424-4eb8-8e00-d4bfbe06e592 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:48.247108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:48.247766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:48.248048 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:48.248322 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:48.249069 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:48.249374 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:48.251398 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:48.259324 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 565/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:48.265886 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:48.360195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac82928-6aa7-4e05-9281-6bcf59b0109d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:48.392514 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:48.393366 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:48.393643 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:48.393912 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] PATH_INFO: `/v3/users/fcb38f3b98c34cf6a7ed7150438105c4` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:48.406887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb38f3b98c34cf6a7ed7150438105c4)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:48.408319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:48.409984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 578/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:48 2022] GET /identity/v3/users/fcb38f3b98c34cf6a7ed7150438105c4 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:48.415597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:48.511621 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4dfa4-45f0-4aa0-b7ee-383a002472be None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:48.543645 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:48.544277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:48.544561 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:48.544835 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:48.563438 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:48.611205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:48.612677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:48.706505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 566/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:48.712179 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:48.723134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:48.807651 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98945f-a05e-4b82-a5c4-e48a56fed857 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:48.840522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649dac-e68f-4f25-9e9d-a4b81605e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:48.841357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649dac-e68f-4f25-9e9d-a4b81605e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:48.841914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649dac-e68f-4f25-9e9d-a4b81605e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:48.841914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649dac-e68f-4f25-9e9d-a4b81605e3a3 None admin] PATH_INFO: `/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:48.843055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01649dac-e68f-4f25-9e9d-a4b81605e3a3 None admin] RBAC: Authorizing `identity:get_project(project_id=83a2dfa5a21d4458b47d261b1740ba7d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:48.844488 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01649dac-e68f-4f25-9e9d-a4b81605e3a3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:48.846140 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 579/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:48 2022] GET /identity/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:48.851980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:48.900381 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:48.950102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d61dd-fa8c-4471-82af-3dc059722270 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:48.983248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:48.984472 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:48.984742 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:48.985016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:48.985842 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=83a2dfa5a21d4458b47d261b1740ba7d, user.id=fcb38f3b98c34cf6a7ed7150438105c4) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:48.986154 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:48.987605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ea2d2-6053-41b8-8163-118851123d31 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:48.992867 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 567/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:48 2022] GET /identity/v3/role_assignments?user.id=fcb38f3b98c34cf6a7ed7150438105c4&scope.project.id=83a2dfa5a21d4458b47d261b1740ba7d&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:51.151391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c90e-dc48-44f1-9105-c891b7d32916 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:51.151949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c90e-dc48-44f1-9105-c891b7d32916 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:51.151949 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c90e-dc48-44f1-9105-c891b7d32916 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:51.153294 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 580/1147] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:51.158646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:51.159087 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:51.159236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:51.175602 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:51.176788 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:51.242176 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 568/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:51.265795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c90e-dc48-44f1-9105-c891b7d32916 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:51.341316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:51.366073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c90e-dc48-44f1-9105-c891b7d32916 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:51.398954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:51.399742 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:51.400028 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:51.400304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:51.416719 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:51.426403 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:51.427491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:51.428524 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:51.429451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 581/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:11:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:51.435761 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:51.479321 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:51.531660 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc6bf-37df-42a8-898a-b1ac99ea154a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:51.563669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:51.564325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:51.564604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:51.564880 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:51.565695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:51.565999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:51.567377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:51.575088 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 569/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:51.581481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:51.678839 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d1cf0-91d5-4a48-8a89-9196b70e3d43 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:51.711082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:51.711944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:51.712229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:51.712507 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] PATH_INFO: `/v3/users/fcb38f3b98c34cf6a7ed7150438105c4` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:51.713778 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb38f3b98c34cf6a7ed7150438105c4)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:51.715246 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:51.719364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 582/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:51 2022] GET /identity/v3/users/fcb38f3b98c34cf6a7ed7150438105c4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:51.725630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:51.822550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447300ca-4cef-41ca-8abe-54261a38fa90 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:51.829822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:51.855791 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fbeb0-6337-400a-a3b7-4e4689717758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:51.856640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fbeb0-6337-400a-a3b7-4e4689717758 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:51.856923 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fbeb0-6337-400a-a3b7-4e4689717758 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:51.857195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fbeb0-6337-400a-a3b7-4e4689717758 None admin] PATH_INFO: `/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:51.858358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fbeb0-6337-400a-a3b7-4e4689717758 None admin] RBAC: Authorizing `identity:get_project(project_id=83a2dfa5a21d4458b47d261b1740ba7d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:51.859848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fbeb0-6337-400a-a3b7-4e4689717758 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:51.861536 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 570/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:51 2022] GET /identity/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:51.867418 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:51.871173 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:51.970098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62f9bd-c98f-4d36-88bb-0c1960ada0d1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:52.002694 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32cc57-da97-4b19-b625-b627854ae4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:52.003593 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32cc57-da97-4b19-b625-b627854ae4c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:52.003872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32cc57-da97-4b19-b625-b627854ae4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:52.004141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32cc57-da97-4b19-b625-b627854ae4c6 None admin] PATH_INFO: `/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d/users/fcb38f3b98c34cf6a7ed7150438105c4/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:52.006066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32cc57-da97-4b19-b625-b627854ae4c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=83a2dfa5a21d4458b47d261b1740ba7d, user_id=fcb38f3b98c34cf6a7ed7150438105c4, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:52.007512 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32cc57-da97-4b19-b625-b627854ae4c6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:52.021499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 583/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:11:51 2022] PUT /identity/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d/users/fcb38f3b98c34cf6a7ed7150438105c4/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:11:54.217759 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79352cf-9f02-4c85-8239-8590a1e739df None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:54.218346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79352cf-9f02-4c85-8239-8590a1e739df None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:54.218346 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79352cf-9f02-4c85-8239-8590a1e739df None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:54.219697 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 571/1154] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:54.225031 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:54.225452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:54.225584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:54.242058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:54.243262 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:54.301694 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:54.311085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 584/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:54.334831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79352cf-9f02-4c85-8239-8590a1e739df None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:54.435193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79352cf-9f02-4c85-8239-8590a1e739df None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:54.468921 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:54.469643 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:54.469925 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:54.470198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:54.480017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:11:54.488114 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:54.489298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:11:54.490545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 572/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:54.495369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:54.591982 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395040dc-98cf-4d7e-a8df-e9fcd2f6c926 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:54.624945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:54.625596 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:54.625877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:54.626151 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:54.626920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:54.627224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:54.628575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:54.636460 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 585/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:54.642780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:54.676589 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:54.746319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920bbb-8506-4f8c-acb3-dd879ffb1ca5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:54.790914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:54.791790 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:54.792076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:54.792349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] PATH_INFO: `/v3/users/fcb38f3b98c34cf6a7ed7150438105c4` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:54.793524 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb38f3b98c34cf6a7ed7150438105c4)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:54.794989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:54.797261 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 573/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:11:54 2022] GET /identity/v3/users/fcb38f3b98c34cf6a7ed7150438105c4 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:54.803101 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:54.857784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:54.900252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21e1e5-dee6-4410-87f1-fcdaec49fd46 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:54.933110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:54.933735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:54.934016 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:54.934289 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:54.998628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:55.000050 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:55.052276 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:55.094905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 586/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:55.100666 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:55.197318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a7a67-940f-46b6-8491-facba8033068 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:55.198940 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:55.232736 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fff85-2ac0-4ec3-84da-1069310f3e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:55.233589 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fff85-2ac0-4ec3-84da-1069310f3e30 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:55.233873 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fff85-2ac0-4ec3-84da-1069310f3e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:55.234146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fff85-2ac0-4ec3-84da-1069310f3e30 None admin] PATH_INFO: `/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:55.235377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fff85-2ac0-4ec3-84da-1069310f3e30 None admin] RBAC: Authorizing `identity:get_project(project_id=83a2dfa5a21d4458b47d261b1740ba7d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:55.236811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fff85-2ac0-4ec3-84da-1069310f3e30 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:55.238499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 574/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:11:55 2022] GET /identity/v3/projects/83a2dfa5a21d4458b47d261b1740ba7d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:55.244408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:55.340596 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af10e2-71e0-4a4d-b7fe-2d9593388687 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:55.373446 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:55.374110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:55.374392 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:55.374666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:55.375522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=83a2dfa5a21d4458b47d261b1740ba7d, user.id=fcb38f3b98c34cf6a7ed7150438105c4) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:55.375836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:55.377257 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dff7b-48b1-4da1-baed-e8073cc95ce0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:55.383043 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 587/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:11:55 2022] GET /identity/v3/role_assignments?user.id=fcb38f3b98c34cf6a7ed7150438105c4&scope.project.id=83a2dfa5a21d4458b47d261b1740ba7d&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:11:57.594442 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6902a-442a-42ab-b4bb-28826e34d53b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:57.594986 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6902a-442a-42ab-b4bb-28826e34d53b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:57.595100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6902a-442a-42ab-b4bb-28826e34d53b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:57.596470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 575/1162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:11:57.601579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:57.602003 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:57.602123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:57.619676 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:11:57.620852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:11:57.635445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:57.686342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 588/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:11:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:11:57.708792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6902a-442a-42ab-b4bb-28826e34d53b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:57.806193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6902a-442a-42ab-b4bb-28826e34d53b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:57.838646 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:57.839304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:57.839587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:57.839859 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:57.877446 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:57.905609 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:57.907076 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:58.001480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 576/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:11:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:11:58.007404 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:58.102108 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f2072-e334-45e5-901c-1c63c23fa6c5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:58.134364 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:58.135172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:58.135452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:58.135721 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:58.142989 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:58.144410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-33a06cb4-e82e-4584-9c81-6eb5b36b195b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:11:58.158491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:11:58.159930 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:11:58.161069 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 589/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:11:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:11:58.165494 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:11:58.231457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:11:58.262333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a11c-b6d6-4e5e-9ad0-844b43879c57 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:11:58.294529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:11:58.295203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:11:58.295486 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:11:58.296276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:11:58.296991 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:11:58.297294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:11:58.298649 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f599-19c5-4dd7-982a-6986dd184ac1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:11:58.305554 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 577/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:11:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:00.476585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb245-ccb3-4a74-8d1a-d3326c0c9c3b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:00.477089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb245-ccb3-4a74-8d1a-d3326c0c9c3b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:00.477188 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb245-ccb3-4a74-8d1a-d3326c0c9c3b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:00.478506 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 590/1167] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:12:00.483612 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f16aa-d930-4591-ad91-09199516caa2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:00.484030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f16aa-d930-4591-ad91-09199516caa2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:00.484175 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f16aa-d930-4591-ad91-09199516caa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:00.500535 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d88f16aa-d930-4591-ad91-09199516caa2 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:12:00.501722 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d88f16aa-d930-4591-ad91-09199516caa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:12:00.566468 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 578/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:12:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:12:00.589529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb245-ccb3-4a74-8d1a-d3326c0c9c3b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:00.602798 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:00.689021 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb245-ccb3-4a74-8d1a-d3326c0c9c3b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:00.721570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0d7b4-f472-42f5-a4e3-70134b6e151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:00.722216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0d7b4-f472-42f5-a4e3-70134b6e151a None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:00.722502 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0d7b4-f472-42f5-a4e3-70134b6e151a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:00.722768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0d7b4-f472-42f5-a4e3-70134b6e151a None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:00.723529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0d7b4-f472-42f5-a4e3-70134b6e151a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:00.724872 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0d7b4-f472-42f5-a4e3-70134b6e151a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:00.738737 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 591/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Thu May 19 14:12:00 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:12:02.960682 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5eb2-1fc4-41eb-97f5-ef61411a5486 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:02.961243 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5eb2-1fc4-41eb-97f5-ef61411a5486 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:02.961243 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5eb2-1fc4-41eb-97f5-ef61411a5486 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:02.962606 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 579/1170] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:12:02.968462 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:02.968900 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:02.969008 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:02.985246 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:12:02.986411 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:12:03.046034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:03.051089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 592/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:12:03.074143 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5eb2-1fc4-41eb-97f5-ef61411a5486 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:03.135622 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:03.173423 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5eb2-1fc4-41eb-97f5-ef61411a5486 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:03.206298 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff538406-a570-4ce9-b085-a7dae0a58f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:03.207172 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538406-a570-4ce9-b085-a7dae0a58f4b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:03.207455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538406-a570-4ce9-b085-a7dae0a58f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:03.207724 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538406-a570-4ce9-b085-a7dae0a58f4b None admin] PATH_INFO: `/v3/domains/7052199f0aed4b06beda13da90a139f6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:03.217758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff538406-a570-4ce9-b085-a7dae0a58f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=7052199f0aed4b06beda13da90a139f6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:03.219196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff538406-a570-4ce9-b085-a7dae0a58f4b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:03.220808 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 580/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:12:03 2022] GET /identity/v3/domains/7052199f0aed4b06beda13da90a139f6 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:03.226609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:03.320573 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f05a2-25ff-420d-869f-c9c9c2f365a8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:03.352607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87076f-98fb-4f95-af6d-d13d5c189e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:03.353244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87076f-98fb-4f95-af6d-d13d5c189e68 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:03.353520 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87076f-98fb-4f95-af6d-d13d5c189e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:03.353790 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87076f-98fb-4f95-af6d-d13d5c189e68 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:03.354490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87076f-98fb-4f95-af6d-d13d5c189e68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:03.355996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87076f-98fb-4f95-af6d-d13d5c189e68 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:03.380847 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 593/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:12:03 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:12:05.602231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd66cd-dcef-4626-a39c-cbc71f68a1ba None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:05.602772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd66cd-dcef-4626-a39c-cbc71f68a1ba None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:05.602772 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd66cd-dcef-4626-a39c-cbc71f68a1ba None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:05.604172 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 581/1174] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:12:05.609518 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:05.609904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:05.610081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:05.627106 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:12:05.628277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:12:05.674140 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:05.694572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 594/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:12:05.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd66cd-dcef-4626-a39c-cbc71f68a1ba None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:05.822887 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd66cd-dcef-4626-a39c-cbc71f68a1ba None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:05.845986 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:05.856425 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e97d0a-5d6e-4056-b322-30e50986a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:05.857274 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e97d0a-5d6e-4056-b322-30e50986a29f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:05.857584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e97d0a-5d6e-4056-b322-30e50986a29f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:05.857853 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e97d0a-5d6e-4056-b322-30e50986a29f None admin] PATH_INFO: `/v3/domains/7052199f0aed4b06beda13da90a139f6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:05.859057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e97d0a-5d6e-4056-b322-30e50986a29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=7052199f0aed4b06beda13da90a139f6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:05.860496 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e97d0a-5d6e-4056-b322-30e50986a29f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:05.862104 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 582/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:12:05 2022] GET /identity/v3/domains/7052199f0aed4b06beda13da90a139f6 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:05.867920 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:05.962326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fcce9-2b1a-4ddd-aab2-19380fc1523e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:05.994557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4ffcb-6edc-4034-9b6d-77948d18932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:05.995227 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4ffcb-6edc-4034-9b6d-77948d18932b None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:05.995504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4ffcb-6edc-4034-9b6d-77948d18932b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:05.995771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4ffcb-6edc-4034-9b6d-77948d18932b None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:05.996471 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4ffcb-6edc-4034-9b6d-77948d18932b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:05.997866 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4ffcb-6edc-4034-9b6d-77948d18932b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:06.017786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 595/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:12:05 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:12:08.256231 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ddb94-f970-4368-a1fa-b1cd7a8d4405 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:08.256767 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ddb94-f970-4368-a1fa-b1cd7a8d4405 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:08.256767 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ddb94-f970-4368-a1fa-b1cd7a8d4405 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:08.258153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 583/1178] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:12:08.263504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:08.264438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:08.264576 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:08.281339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:12:08.282507 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:12:08.310125 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:08.347517 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 596/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:12:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:12:08.370451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ddb94-f970-4368-a1fa-b1cd7a8d4405 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:08.470805 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ddb94-f970-4368-a1fa-b1cd7a8d4405 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:08.503901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:08.504690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:08.504972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:08.505246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:08.516146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:12:08.523641 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:12:08.524683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:12:08.525576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 584/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:12:08.530817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:08.625329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a3b85-bcce-401a-9703-eebeac18326f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:08.658637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:08.659328 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:08.659614 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:08.659896 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:08.660639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:12:08.660948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:08.662304 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:08.670706 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 597/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:08.676371 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:08.726693 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:08.773803 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70300-ce73-4ddd-a099-384ed27e67ef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:08.806075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:08.806956 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:08.807238 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:08.807511 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] PATH_INFO: `/v3/users/2dabf3d27f584552a976a31dff447daa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:08.820092 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] RBAC: Authorizing `identity:get_user(user_id=2dabf3d27f584552a976a31dff447daa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:08.821533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:08.823199 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 585/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:12:08 2022] GET /identity/v3/users/2dabf3d27f584552a976a31dff447daa => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:08.829435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:08.860078 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:08.928904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e482-f327-457d-93d8-d77ebf6854c8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:08.973813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:08.974459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:08.974740 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:08.975046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:09.042807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:09.044169 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:09.071864 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:09.138013 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 598/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:12:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:12:09.144418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:09.239389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159cc79-d503-470e-b407-fd657d9e6602 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:09.250168 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:09.274517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77c0e-4672-4bee-89bf-aac2d0edfad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:09.275440 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77c0e-4672-4bee-89bf-aac2d0edfad7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:09.275720 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77c0e-4672-4bee-89bf-aac2d0edfad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:09.275992 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77c0e-4672-4bee-89bf-aac2d0edfad7 None admin] PATH_INFO: `/v3/projects/28103230955644a3a5081afea517addb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:09.277202 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77c0e-4672-4bee-89bf-aac2d0edfad7 None admin] RBAC: Authorizing `identity:get_project(project_id=28103230955644a3a5081afea517addb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:09.278651 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77c0e-4672-4bee-89bf-aac2d0edfad7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:09.280399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 586/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:12:09 2022] GET /identity/v3/projects/28103230955644a3a5081afea517addb => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:09.287329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:09.382656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5458-af7c-4951-bf0c-9b2765e2e11f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:09.411677 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:09.417418 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:09.418070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:09.418349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:09.418622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:09.419472 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=28103230955644a3a5081afea517addb, user.id=2dabf3d27f584552a976a31dff447daa) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:12:09.420308 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:09.421724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff708cb0-25b5-440f-bbe3-73da2f434dbf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:09.427110 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 599/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:12:09 2022] GET /identity/v3/role_assignments?user.id=2dabf3d27f584552a976a31dff447daa&scope.project.id=28103230955644a3a5081afea517addb&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:11.590067 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5cbe3-3a0c-456a-8ac9-457c570840fe None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:11.590586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5cbe3-3a0c-456a-8ac9-457c570840fe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:11.590695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5cbe3-3a0c-456a-8ac9-457c570840fe None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:11.592048 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 587/1186] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:12:11.597076 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:11.597493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:11.597628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:11.613925 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:12:11.615122 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:12:11.680345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 600/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:12:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:12:11.703355 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5cbe3-3a0c-456a-8ac9-457c570840fe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:11.801971 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5cbe3-3a0c-456a-8ac9-457c570840fe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:11.834653 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:11.835524 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:11.835809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:11.836084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:11.845934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:12:11.853558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:12:11.854473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:12:11.855542 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 588/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:12:11.861041 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:11.957017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86e640-991c-4423-9dc1-fefa8f47145a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:11.979699 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:11.990355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:11.991031 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:11.991314 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:11.991586 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:11.992326 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:12:11.992630 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:11.993983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:12.001821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 601/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:12.007600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:12.047482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:12.106506 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d99e-aed8-4ded-a1c3-a4538dd3ef35 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:12.144997 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:12.145864 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:12.146148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:12.146426 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] PATH_INFO: `/v3/users/2dabf3d27f584552a976a31dff447daa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:12.147640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] RBAC: Authorizing `identity:get_user(user_id=2dabf3d27f584552a976a31dff447daa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:12.149099 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:12.150744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 589/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:12:12 2022] GET /identity/v3/users/2dabf3d27f584552a976a31dff447daa => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:12.156413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:12.252831 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99ce3-e62f-410f-8024-09ccaee76065 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:12.285170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d638dd1-aef6-4a12-bfd0-7d9ea4f2d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:12.286019 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638dd1-aef6-4a12-bfd0-7d9ea4f2d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:12.286298 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638dd1-aef6-4a12-bfd0-7d9ea4f2d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:12.286708 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638dd1-aef6-4a12-bfd0-7d9ea4f2d8e7 None admin] PATH_INFO: `/v3/projects/28103230955644a3a5081afea517addb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:12.287770 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d638dd1-aef6-4a12-bfd0-7d9ea4f2d8e7 None admin] RBAC: Authorizing `identity:get_project(project_id=28103230955644a3a5081afea517addb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:12.289193 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d638dd1-aef6-4a12-bfd0-7d9ea4f2d8e7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:12.290905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 602/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:12:12 2022] GET /identity/v3/projects/28103230955644a3a5081afea517addb => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:12.298117 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:12.395080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb22707-89ab-41cb-8db5-be30490b3f7a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:12.402256 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:12.429084 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af020-a764-46f4-ad9e-ec3abc240498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:12.429961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af020-a764-46f4-ad9e-ec3abc240498 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:12.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af020-a764-46f4-ad9e-ec3abc240498 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:12.430504 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af020-a764-46f4-ad9e-ec3abc240498 None admin] PATH_INFO: `/v3/projects/28103230955644a3a5081afea517addb/users/2dabf3d27f584552a976a31dff447daa/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:12.432431 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af020-a764-46f4-ad9e-ec3abc240498 None admin] RBAC: Authorizing `identity:create_grant(project_id=28103230955644a3a5081afea517addb, user_id=2dabf3d27f584552a976a31dff447daa, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:12.433838 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af020-a764-46f4-ad9e-ec3abc240498 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:12.446213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 590/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:12:12 2022] PUT /identity/v3/projects/28103230955644a3a5081afea517addb/users/2dabf3d27f584552a976a31dff447daa/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:12:14.611633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b7c2-b767-48cb-95ad-8119301a7c19 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:14.612257 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b7c2-b767-48cb-95ad-8119301a7c19 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:14.612257 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b7c2-b767-48cb-95ad-8119301a7c19 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:14.613537 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 603/1193] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:12:14.618886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:14.619312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:14.619503 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:14.637181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:12:14.639377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:12:14.720548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 591/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:12:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:12:14.743687 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b7c2-b767-48cb-95ad-8119301a7c19 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:14.800642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:14.846250 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b7c2-b767-48cb-95ad-8119301a7c19 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:14.877747 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:14.878522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:14.878819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:14.879096 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:14.889944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:12:14.897456 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:12:14.898622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:12:14.899842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 604/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:12:14.905233 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:14.994357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:15.000618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f26d-5027-4eb6-962f-3d3b82471cb8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:15.047096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:15.047766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:15.048044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:15.048318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:15.049070 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:12:15.049377 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:15.050747 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:15.058692 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 592/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:15.065377 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:15.160957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab16bd-6697-4ac0-b63f-e86c92447985 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:15.174255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:15.194238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:15.195114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:15.195394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:15.195663 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] PATH_INFO: `/v3/users/2dabf3d27f584552a976a31dff447daa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:15.196824 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] RBAC: Authorizing `identity:get_user(user_id=2dabf3d27f584552a976a31dff447daa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:15.198249 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:15.199883 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 605/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:12:15 2022] GET /identity/v3/users/2dabf3d27f584552a976a31dff447daa => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:15.206163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:15.303291 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fcf1-392d-4807-a3b1-08c427aed5e0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:15.335884 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:15.336539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:15.336827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:15.337107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:15.362841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:15.403499 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:15.404811 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:15.500248 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 593/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:12:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:12:15.506107 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:15.603208 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b228e74-4157-43ed-a2fd-4c84900c9292 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:15.635945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dffe0f-e100-49f9-827f-c192d760a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:15.637046 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dffe0f-e100-49f9-827f-c192d760a181 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:15.637321 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dffe0f-e100-49f9-827f-c192d760a181 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:15.637589 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dffe0f-e100-49f9-827f-c192d760a181 None admin] PATH_INFO: `/v3/projects/28103230955644a3a5081afea517addb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:15.639299 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dffe0f-e100-49f9-827f-c192d760a181 None admin] RBAC: Authorizing `identity:get_project(project_id=28103230955644a3a5081afea517addb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:15.640707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dffe0f-e100-49f9-827f-c192d760a181 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:15.642448 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 606/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:12:15 2022] GET /identity/v3/projects/28103230955644a3a5081afea517addb => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:15.648647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:12:15.706264 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:15.746470 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52647578-16d1-476e-8339-b2afb838e731 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:12:15.780101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:12:15.780747 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:12:15.781033 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:12:15.781311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:12:15.782144 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=28103230955644a3a5081afea517addb, user.id=2dabf3d27f584552a976a31dff447daa) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:12:15.782454 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:12:15.783909 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02274e-db61-4592-9a01-2e00de791448 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:12:15.789576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 594/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:12:15 2022] GET /identity/v3/role_assignments?user.id=2dabf3d27f584552a976a31dff447daa&scope.project.id=28103230955644a3a5081afea517addb&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:12:25.631876 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=75 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:12:25.787093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=39 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:16.186172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2cf02-c468-4e0f-a19e-105210a8aa75 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:16.186808 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2cf02-c468-4e0f-a19e-105210a8aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:16.186808 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2cf02-c468-4e0f-a19e-105210a8aa75 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:16.188374 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 607/1201] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:16.193591 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:16.194053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:16.194206 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:16.212836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:16.214055 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:16.287100 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 595/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:16.311686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2cf02-c468-4e0f-a19e-105210a8aa75 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:16.435228 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2cf02-c468-4e0f-a19e-105210a8aa75 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:16.478652 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:16.479445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:16.479698 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:16.479940 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:16.491683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:16.493300 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:16.512475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:16.514398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:16.515984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:16.515984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:16.515984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:16.515984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:16.515984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 608/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:16.519984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:16.651272 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495b2fa-569b-400a-bdc3-fc79fd82e556 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:16.685087 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:16.693416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:16.694548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:16.695110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:16.695424 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:16.697078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:16.697577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:16.699695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cbf4-110b-4c3b-9658-0cefcda58f2c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:16.714837 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 596/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:16.719903 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:16.782530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:16.842141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b23a-be34-4c2b-844d-550b23a5c7e3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:16.882136 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f9cf-b507-4729-ad24-d21b0188d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:16.883769 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f9cf-b507-4729-ad24-d21b0188d390 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:16.886879 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f9cf-b507-4729-ad24-d21b0188d390 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:16.887255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f9cf-b507-4729-ad24-d21b0188d390 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:16.888072 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f9cf-b507-4729-ad24-d21b0188d390 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:16.889822 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f9cf-b507-4729-ad24-d21b0188d390 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:16.916754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 609/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:13:16 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:13:19.389397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafc98-c5c3-4861-87bf-590246d43c97 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:19.390086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafc98-c5c3-4861-87bf-590246d43c97 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:19.390086 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafc98-c5c3-4861-87bf-590246d43c97 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:19.391763 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 597/1206] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:19.399283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:19.399283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:19.399283 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:19.416536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:19.417835 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:19.500279 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 610/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:19.529793 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fafc98-c5c3-4861-87bf-590246d43c97 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:19.664794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fafc98-c5c3-4861-87bf-590246d43c97 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:19.709633 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:19.710434 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:19.710714 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:19.711560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:19.725304 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:13:19.735500 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:19.736699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:19.737593 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 598/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:13:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:19.743849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:19.794296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:19.874745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03e32-3edd-4dcb-8b94-b3150cdb2eca None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:19.920370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:19.920981 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:19.921215 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:19.921484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:19.922237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:19.922544 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:19.923950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:19.933114 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 611/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:13:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:19.938843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:20.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:20.063411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a678-169b-428b-aba3-fa0fb8511ed3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:20.108356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:20.109342 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:20.109741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:20.109998 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:20.126130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:20.127901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:20.149765 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:20.151260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:20.157215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:20.157215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:20.157215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:20.157215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:20.157215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 599/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:20.157514 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:20.266762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:20.270646 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90a98a-9cbf-4230-9230-e9bb4d5af0fc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:20.306090 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:20.306767 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:20.307068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:20.307343 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:20.308794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:20.308794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:20.309734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:20.322059 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 612/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:13:20.327877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:20.443292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53440-aab7-4246-a6dd-9d9817fb0504 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:20.444959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:20.486047 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:20.486892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:20.487182 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:20.487530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:20.495240 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:20.496683 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:13:20.512039 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:20.513068 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:20.518861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 600/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:20.519475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:20.624444 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01897dfc-d1fb-4711-afcd-84496580805f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:20.659740 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:20.660530 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:20.660760 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:20.660978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:20.661898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:20.662136 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:20.663536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:20.686597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 613/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:13:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:20.687840 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:20.800339 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744087-032d-42bc-837d-a8c9440782e1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:20.839903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:20.840642 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:20.841679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:20.841679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:20.874670 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:20.918936 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:20.920584 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:21.037448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 601/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:13:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:13:21.043218 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:21.064320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:21.158572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9af2-fdee-4710-ad04-3ecef73a2d09 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:21.193556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:21.194397 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:21.194726 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:21.195079 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:21.206414 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:21.207963 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:21.227373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:21.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:21.229598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:21.229598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:21.229598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:21.229598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:21.235179 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 614/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:21.236495 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:21.304035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:21.347320 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d088f-f614-403c-a683-6b65fddbd7cf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:21.384605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:21.385266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:21.385545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:21.385819 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:21.386539 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:21.386868 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:21.388260 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:21.404552 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 602/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:21.405734 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:21.480991 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:21.517232 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5f3a9-f4c2-4ee0-b6f3-4ccdc31dc5fa None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:21.554157 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:21.555177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:21.555555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:21.555922 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:21.563362 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:21.565029 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:13:21.581536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:21.582604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:21.583703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:21.587468 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 615/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:21.589388 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:21.705858 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510c86-b9f3-4593-baee-0bf54c43f6f4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:21.734612 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:21.751984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:21.752779 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:21.753126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:21.753474 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:21.754353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:21.754738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:21.756316 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3de44e-31a7-4931-816c-753987277f35 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:21.772217 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 603/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:21.779536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:21.896642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97cba-0e31-475e-95f2-0445836c25b0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:21.934483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:21.941365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:21.942238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:21.942519 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:21.942867 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:21.943861 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=e31c89ce187140a4912cbf9536b480fb) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:21.944267 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:21.945724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ab66c-032a-4fc0-b3ea-e62cf817f06a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:21.952023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 616/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:13:21 2022] GET /identity/v3/role_assignments?user.id=e31c89ce187140a4912cbf9536b480fb&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:13:24.324291 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930110-4bba-4a5f-b6a3-96c036529bde None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:24.324911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930110-4bba-4a5f-b6a3-96c036529bde None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:24.324911 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930110-4bba-4a5f-b6a3-96c036529bde None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:24.326836 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 604/1220] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:24.333252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:24.333844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:24.333844 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:24.354807 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:24.356353 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:24.449248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 617/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:24.473725 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930110-4bba-4a5f-b6a3-96c036529bde None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:24.590009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930110-4bba-4a5f-b6a3-96c036529bde None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:24.627900 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:24.628704 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:24.628993 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:24.629295 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:24.643960 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:13:24.651804 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:24.652914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:24.659664 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 605/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:24.660359 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:24.768132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d3b4-9d24-411c-915c-5a7934787e9b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:24.792735 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:24.804212 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:24.805502 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:24.805891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:24.806238 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:24.807164 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:24.807701 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:24.809553 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:24.822469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 618/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:24.830103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:24.883888 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:24.943145 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ae0a-f1eb-4e45-a937-eb5345db278c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:24.978959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:24.979756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:24.980035 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:24.980306 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:24.992009 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:24.993454 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:25.012659 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:25.013821 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:25.014856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:25.014856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:25.014856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:25.014856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:25.014856 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 606/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:25.019941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:25.123683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637617-b6c5-4e23-af53-8df06ee26f8a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:25.164761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:25.165428 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:25.165732 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:25.165995 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:25.166967 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:25.167307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:25.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:25.186842 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 619/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:13:25.189969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:25.300638 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:25.308671 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e2c-0971-4efd-b985-05d7a3edbe61 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:25.345398 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:25.346268 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:25.346548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:25.346951 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:25.355449 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:25.356896 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:13:25.372758 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:25.374007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:25.375428 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 607/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:25.380082 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:25.438272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:25.494898 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329c64c-a3df-4c99-a9ee-bb22752bc5a8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:25.532051 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:25.532864 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:25.533261 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:25.533615 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:25.534463 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:25.534834 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:25.536348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:25.563160 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 620/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:13:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:25.564492 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:25.675800 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513c798-bec3-4a24-8326-313a93afe7e1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:25.714318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:25.715293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:25.715525 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:25.715917 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:25.728865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:25.730597 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:25.747809 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:25.748892 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:25.749794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:25.749794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:25.749794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:25.749794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:25.749794 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 608/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:25.754617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:25.875157 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2ac5-0fc3-490a-93bf-4e92bd687672 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:25.877891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:25.914255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:25.914979 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:25.915245 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:25.915628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:25.916459 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:25.916858 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:25.918690 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:25.932180 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 621/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:25.938064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:25.949368 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:26.055056 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bda3-3d56-49df-9eb5-15bca04d29a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:26.093998 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:26.094886 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:26.095218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:26.095519 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:26.102599 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:26.104198 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:13:26.121116 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:26.122276 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:26.123405 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 609/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:26.128277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:26.244341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d505-ee74-4aa1-9ed9-ffed041cac12 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:26.281873 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:26.282523 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:26.282815 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:26.283091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:26.283865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:26.284168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:26.286617 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757073f6-03c8-4719-9b52-cab3cf2bb85f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:26.299206 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 622/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:26.305636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:26.377928 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:26.416318 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72129442-e7b0-44d5-859d-03168d5b22ea None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:26.456336 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e349574-639d-47ae-aff2-6dc85ec33ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:26.457236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349574-639d-47ae-aff2-6dc85ec33ca3 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:26.457517 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349574-639d-47ae-aff2-6dc85ec33ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:26.457792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349574-639d-47ae-aff2-6dc85ec33ca3 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/e31c89ce187140a4912cbf9536b480fb/roles/b9314260e70b4718b9f4785feeb9ad8a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:26.472939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e349574-639d-47ae-aff2-6dc85ec33ca3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=e31c89ce187140a4912cbf9536b480fb, role_id=b9314260e70b4718b9f4785feeb9ad8a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:26.474399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e349574-639d-47ae-aff2-6dc85ec33ca3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:26.487004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 610/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:13:26 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/e31c89ce187140a4912cbf9536b480fb/roles/b9314260e70b4718b9f4785feeb9ad8a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:13:28.771952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf09e1-d3aa-4480-bfa9-e03c5baa37df None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:28.771952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf09e1-d3aa-4480-bfa9-e03c5baa37df None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:28.771952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf09e1-d3aa-4480-bfa9-e03c5baa37df None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:28.771952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 623/1233] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:28.778207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:28.778782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:28.778782 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:28.798771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:28.800246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:28.877938 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 611/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:28.907343 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf09e1-d3aa-4480-bfa9-e03c5baa37df None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:28.934605 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:29.017754 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf09e1-d3aa-4480-bfa9-e03c5baa37df None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:29.055984 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:29.056785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:29.057085 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:29.057421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:29.068331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:13:29.076607 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:29.077756 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:29.078771 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 624/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:13:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:29.083827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:29.140020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:29.209191 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448565b6-1ce9-4d73-a997-1e5c8ae4a4a7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:29.249292 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:29.249961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:29.250238 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:29.250547 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:29.251369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:29.251703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:29.253227 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:29.262452 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 612/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:29.268555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:29.362814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:29.380112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec99f12-70e0-449f-8203-6f225bf9f9ad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:29.419372 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:29.420301 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:29.420570 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:29.420890 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:29.432387 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:29.433840 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:29.453832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:29.454891 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:29.455784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:29.455784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:29.455784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:29.455784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:29.455784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 625/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:29.461695 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:29.571041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c558d-0d57-44c6-85fc-770442af17ce None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:29.579906 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:29.607057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:29.607904 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:29.608209 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:29.608483 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:29.609203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:29.609512 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:29.612942 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:29.627177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 613/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:29.633957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:29.750852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7084a6-bfe1-42c9-8cec-b716f0d14c14 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:29.790893 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:29.792150 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:29.792603 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:29.792981 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:29.796376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:29.803355 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:29.805342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:13:29.825693 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:29.827814 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:29.828985 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 626/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:29.833404 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:29.950308 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad38727-fa44-4546-ba58-a5f074355c48 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:29.988409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:29.989089 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:29.989363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:29.989644 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:29.990490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:29.990830 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:29.992281 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:30.013031 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 614/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:13:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:30.018905 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:30.129315 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b9d1-ebb7-4145-a8f2-dab24105311f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:30.168557 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:30.169189 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:30.169466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:30.169772 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:30.242706 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:30.250509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:30.252259 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:30.369926 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 627/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:13:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:13:30.376566 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:30.408576 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:30.492001 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc304708-fc4e-45b4-861c-cfbe7c5d524a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:30.531493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:30.532387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:30.532741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:30.533093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:30.545312 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:30.546979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:30.566848 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:30.567849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:30.568752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:30.568752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:30.568752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:30.568752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:30.568752 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 615/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:30.574058 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:30.678454 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:30.685469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aa36e-cc7d-4534-9433-2cde80b3a28a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:30.723172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:30.723830 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:30.724104 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:30.724385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:30.725123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:30.725410 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:30.726803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:30.738134 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 628/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:30.743916 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:30.830203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:30.854027 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793cf25-5e24-4e65-9668-e812a509980e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:30.898121 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:30.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:30.899607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:30.899877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:30.906764 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:30.908334 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:13:30.921926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:30.923044 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:30.923948 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 616/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:30.929794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:31.038171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26937b-0b0e-4080-a520-ce2a0625913e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:31.073803 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:31.074488 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:31.074764 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:31.075068 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:31.075848 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:31.076153 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:31.077559 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2cd2c-b8db-44a7-994c-02e7d6f975f0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:31.090811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 629/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:13:31.096774 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:31.216057 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51c31-003a-4688-80d9-b622573d719e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:31.258102 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:31.259016 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:31.259340 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:31.259616 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:31.260626 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] RBAC: Adding query filter params (role.id=b9314260e70b4718b9f4785feeb9ad8a, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=e31c89ce187140a4912cbf9536b480fb) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:31.260924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:31.262403 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3307b7-7c9f-4e04-a020-f2fa751099f2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:31.269874 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 617/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:13:31 2022] GET /identity/v3/role_assignments?user.id=e31c89ce187140a4912cbf9536b480fb&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=b9314260e70b4718b9f4785feeb9ad8a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:33.552248 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a9b6-f477-40c8-9c76-27faed74c7d3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:33.552774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a9b6-f477-40c8-9c76-27faed74c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:33.553004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a9b6-f477-40c8-9c76-27faed74c7d3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:33.554868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 630/1247] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:33.560690 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:33.561103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:33.561309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:33.568457 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:33.583477 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:33.585679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:33.660947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 618/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:33.684415 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a9b6-f477-40c8-9c76-27faed74c7d3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:33.703505 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:33.797859 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a9b6-f477-40c8-9c76-27faed74c7d3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:33.835307 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:33.836091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:33.836365 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:33.836629 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:33.847531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:13:33.855217 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:33.856371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:33.857369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 631/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:33.862545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:33.967353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4f899-7dc9-44b1-af21-d44fd1bb649d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:33.998708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:34.005059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:34.005801 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:34.006093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:34.007243 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:34.008051 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:34.008363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:34.009698 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:34.018723 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 619/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:34.024552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:34.105805 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:34.131165 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffc6eb-a4a2-4924-a576-591aa98bfc1a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:34.172584 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:34.173560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:34.173705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:34.173912 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:34.188316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:34.189813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:34.208933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:34.210077 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:34.211186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:34.211186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:34.211186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:34.211186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:34.211186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 632/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:34.216245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:34.325652 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca036bf-a48f-4ab9-9776-2a24effd00ed None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:34.360392 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:34.361067 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:34.361348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:34.361620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:34.362357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:34.362660 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:34.364103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:34.377861 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 620/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:34.384034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:34.493048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d5c63-8adf-4073-bfbf-470cab8db6a3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:34.520297 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:34.528850 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:34.529672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:34.529948 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:34.530219 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:34.539362 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:34.540826 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:13:34.556786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:34.558487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:34.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:34.562997 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 633/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:34.563934 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:34.622309 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:34.669105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab0a6e-c7fb-4dbd-b7cb-a55aa7bd33d1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:34.703604 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:34.704274 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:34.704550 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:34.704816 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:34.705648 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:34.705947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:34.707432 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:34.725049 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 621/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:13:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:13:34.731457 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:34.835913 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9288f-3cac-45be-ab82-60bd45bed163 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:34.869820 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:34.870470 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:34.870753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:34.871057 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:34.927897 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:34.940528 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:34.941954 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:35.038206 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 634/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:13:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:13:35.043963 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:35.140546 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7760-3f1e-4ee1-a436-25cf9be757c1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:35.155416 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:35.177814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:35.178658 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:35.178915 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:35.179184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:35.189498 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:35.190986 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:35.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:35.210518 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:35.211600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:35.211600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:35.211600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:35.211600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:35.211600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 622/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:35.216379 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:35.299854 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:35.312062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8e95-1990-4d7e-9aa2-74e3e1336e47 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:35.344739 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:35.345385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:35.345666 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:35.345942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:35.346656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:35.346996 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:35.348344 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:35.359204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 635/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:35.364605 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:35.460215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5b791-2f5b-46cc-b2cc-aee0ead9912e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:35.492473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:35.493243 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:35.493545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:35.493865 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:35.500296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:35.501739 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:13:35.515920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:35.516962 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:35.518059 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 623/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:35.523312 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:35.620797 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44480-8376-4de1-881c-850aa8e48465 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:35.653359 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:35.654004 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:35.654284 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:35.654556 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:35.655357 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:35.655662 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:35.657070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf0706-c5c4-46e2-99f6-a022f9d9269e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:35.669474 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 636/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:35.675363 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:35.700745 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:35.773455 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6884a4-059c-4e54-8066-0b3715023cca None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:35.805077 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:35.805711 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:35.805994 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:35.806267 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:35.807205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=e31c89ce187140a4912cbf9536b480fb) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:35.807520 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:35.808947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9ed74-9762-42c6-b971-6bdd1e9780ec None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:35.814230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 624/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:13:35 2022] GET /identity/v3/role_assignments?user.id=e31c89ce187140a4912cbf9536b480fb&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:38.096198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d4e9f-b885-4758-94df-49ff8749a938 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.096761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d4e9f-b885-4758-94df-49ff8749a938 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.096761 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d4e9f-b885-4758-94df-49ff8749a938 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.098094 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 637/1261] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:38.103202 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.103703 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.103795 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.120217 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:38.121407 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:38.195790 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 625/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:38.220612 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d4e9f-b885-4758-94df-49ff8749a938 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:38.233241 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:38.326485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d4e9f-b885-4758-94df-49ff8749a938 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:38.358079 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:38.358816 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.359091 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.359381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.369484 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:13:38.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:38.378022 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:38.379047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 638/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:38.385042 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:38.404779 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:38.485391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1db5b-7d9e-4b68-ade0-4bc0794eea93 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:38.519282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:38.519935 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.520212 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.520480 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.521224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:38.521531 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:38.522968 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:38.530685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 626/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:38.536572 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:38.600388 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:38.637656 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a293af-0a1f-404b-ada9-842f76245d99 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:38.670434 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:38.671262 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.671542 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.671813 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.682541 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:38.684005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:38.700483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:38.701509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:38.702624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:38.702624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:38.702624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:38.702624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:38.702624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 639/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:38.707395 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:38.785709 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:38.805301 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dfdd0-9402-4afc-9304-4a800bd5499d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:38.836965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:38.837618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.837901 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.838174 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.838922 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:38.839230 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:38.840588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:38.852396 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 627/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:38.857933 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:38.954804 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669fb8-ad22-47d7-9d5a-88a9b229ee5e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:38.973819 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:38.987490 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:38.988274 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:38.988552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:38.988821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:38.998733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.000195 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:13:39.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:39.016500 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:39.017686 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 640/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:39.023002 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:39.118967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7338ef-a968-41e0-b095-554dc5eb1c96 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:39.153969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:39.154675 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:39.155079 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:39.155402 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:39.156358 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:39.156702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.158776 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.169685 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:39.179669 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 628/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:13:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:39.185395 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:39.282316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77944b10-1089-4227-80f5-5fdf13fe692d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:39.316398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:39.317172 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:39.317447 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:39.317714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:39.328552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.329987 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:39.346336 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:39.347319 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:39.348493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:39.348493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:39.348493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:39.348493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:39.348493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 641/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:13:39.353153 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:39.450757 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a78995-5b95-4201-9e53-b64fbeeb726c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:39.483333 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:39.483987 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:39.484267 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:39.484541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:39.485265 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:39.485568 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.486979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.498349 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 629/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:39.503874 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:39.534216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:39.599221 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282030a-1243-40e1-8f22-996b7bed1213 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:39.633433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:39.634204 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:39.634481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:39.634747 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:39.641147 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.642552 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:13:39.656466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:39.657560 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:39.658683 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 642/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:13:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:39.663914 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:39.721823 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:39.763705 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121298a-b176-43f6-83d3-1d2e6ef038db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:39.796189 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:39.796771 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:39.797050 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:39.797319 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:39.798093 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:39.798394 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.799839 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67231852-ec32-4d67-ac0b-ef0a2bbbca9a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.812005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 630/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:13:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:39.817871 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:39.907631 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:39.917482 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dafe0-9dfc-4107-bd59-7ba578c46843 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:39.949765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640f60-ad68-4f69-b35f-28cb044c9c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:39.950636 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640f60-ad68-4f69-b35f-28cb044c9c32 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:39.950950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640f60-ad68-4f69-b35f-28cb044c9c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:39.951223 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640f60-ad68-4f69-b35f-28cb044c9c32 None admin] PATH_INFO: `/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/e31c89ce187140a4912cbf9536b480fb/roles/5a23f60e5ff34948b5fb3cfa69d6dcca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:39.953133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640f60-ad68-4f69-b35f-28cb044c9c32 None admin] RBAC: Authorizing `identity:create_grant(project_id=f78edebdfaab4204a54167b2bcc034af, user_id=e31c89ce187140a4912cbf9536b480fb, role_id=5a23f60e5ff34948b5fb3cfa69d6dcca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:39.954650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640f60-ad68-4f69-b35f-28cb044c9c32 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:39.967724 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 643/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:13:39 2022] PUT /identity/v3/projects/f78edebdfaab4204a54167b2bcc034af/users/e31c89ce187140a4912cbf9536b480fb/roles/5a23f60e5ff34948b5fb3cfa69d6dcca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:13:42.128707 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01ef64-89e5-4974-ac38-585320d12f8f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:42.129236 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01ef64-89e5-4974-ac38-585320d12f8f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:42.129323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01ef64-89e5-4974-ac38-585320d12f8f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:42.130630 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 631/1274] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:42.136587 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:42.136959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:42.137135 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:42.154369 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:42.155575 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:42.224115 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 644/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:42.247481 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01ef64-89e5-4974-ac38-585320d12f8f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:42.349831 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01ef64-89e5-4974-ac38-585320d12f8f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:42.364980 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:42.383850 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:42.384569 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:42.384845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:42.385115 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:42.395013 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:13:42.402529 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:42.403706 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:42.405386 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 632/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:42.409614 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:42.488322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:42.507705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3afc-cf4d-44f4-981d-da911d0fbda2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:42.540070 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:42.540714 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:42.540988 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:42.541255 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:42.541983 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:42.542282 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:42.543653 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:42.551371 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 645/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:42.557588 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:42.656103 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c403e-6ecb-458c-b771-d2073be5d4df None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:42.702466 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:42.703296 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:42.703577 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:42.703897 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:42.714464 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:42.715969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:42.733034 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:42.733927 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:42.734849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:42.734849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:42.734849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:42.734849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:42.734849 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 633/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:42.739942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:42.839910 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8f4c-68af-449d-be13-b1f0064cc78d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:42.872460 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:42.873098 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:42.873373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:42.873642 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:42.874349 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:42.874648 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:42.876025 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:42.887821 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 646/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:42.893505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:42.924586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:42.992731 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4ca4b-4f37-4d17-8a34-9fe849eb6511 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:43.027949 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:43.030308 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:43.030600 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:43.030915 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:43.043106 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:43.044563 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:13:43.059262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:43.060391 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:13:43.061540 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:43.062970 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 634/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:43.066296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:43.070145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:43.163496 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76f5cb-4c73-4567-bfae-42e889c0005e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:43.196102 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:43.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:43.197112 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:43.197381 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:43.198198 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:43.198504 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:43.199944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:43.216795 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 647/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:13:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:43.222513 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:43.309619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:43.319661 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983b12-5bd0-4bb1-9fa3-8a38a10d7bff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:43.352126 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:43.352768 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:43.353135 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:43.353411 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:43.422006 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:43.423497 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:43.508785 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:43.518844 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 635/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:13:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:13:43.525242 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:43.585005 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:43.622344 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb9df-b94d-4575-8fb2-e7abfe4442e4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:43.655432 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:43.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:43.656485 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:43.656757 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:43.666464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:43.667921 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:13:43.685348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:43.686398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:43.687531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:13:43.687531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:13:43.687531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:13:43.687531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:43.687531 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 648/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:43.692216 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:43.787148 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ba58-bc09-4aff-bab1-aeb362035a44 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:43.820113 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:43.820756 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:43.821032 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:43.821311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:43.822020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:43.822315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:43.823699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:43.834469 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 636/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:43.839957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:43.938418 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed51c-8570-47a5-91f9-f3d27188be28 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:43.952421 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:43.972672 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:43.973451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:43.973729 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:43.973999 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:43.980527 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:43.981951 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:13:43.995266 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:43.996277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: ERROR keystone.server.flask.application May 19 14:13:43.997579 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 649/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:44.002244 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:44.051300 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:44.099359 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948da4-48b7-42ce-a055-d5efa3bb9314 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:44.131860 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:44.132510 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:44.132790 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:44.133062 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:44.133846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:44.134245 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:44.135686 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af53e-bb59-429e-9017-1964f6d02258 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:44.149414 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 637/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:44.155348 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:44.250633 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac3f3-66c0-40f6-8ee8-1ce67449e454 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:44.283609 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:44.284237 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:44.284515 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:44.284786 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:44.285599 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] RBAC: Adding query filter params (role.id=5a23f60e5ff34948b5fb3cfa69d6dcca, scope.project.id=f78edebdfaab4204a54167b2bcc034af, user.id=e31c89ce187140a4912cbf9536b480fb) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:44.285904 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:44.287356 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea7b40-e72b-4fc6-9c2d-9e31c8298679 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:44.293020 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 650/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:13:44 2022] GET /identity/v3/role_assignments?user.id=e31c89ce187140a4912cbf9536b480fb&scope.project.id=f78edebdfaab4204a54167b2bcc034af&role.id=5a23f60e5ff34948b5fb3cfa69d6dcca => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:46.520884 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917661f-b650-48fb-a257-51ede9309e3f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:46.522041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917661f-b650-48fb-a257-51ede9309e3f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:46.522041 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917661f-b650-48fb-a257-51ede9309e3f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:46.523409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 638/1288] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:46.528424 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:46.528817 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:46.528976 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:46.546062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:46.547260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:46.576042 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:46.611285 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 651/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:46.634178 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917661f-b650-48fb-a257-51ede9309e3f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:46.732532 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917661f-b650-48fb-a257-51ede9309e3f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:46.743385 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:46.767208 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:46.767999 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:46.768283 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:46.768560 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:46.769218 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:46.770585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:46.782275 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:46.783533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:46.784613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 639/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:13:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:46.789345 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:46.885275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764ba2b-f912-46b0-a506-d637c263a4d4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:46.918644 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:46.919313 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:46.919595 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:46.919868 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:46.920564 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:46.920865 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:46.922224 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0348407-868e-4932-a5fd-476eb963f157 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:46.926960 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 652/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:13:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:46.932466 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:47.030932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62fbc-8d5a-4582-a848-cf0be8c93307 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:47.062875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:47.063533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:47.063818 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:47.064096 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:47.064812 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:47.065118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:47.066493 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede4ec-57e8-4877-abf3-e49c3c4e8762 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:47.071666 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 640/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:13:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:49.244048 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea345f-9c9f-4976-82d1-847f91d0d254 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:49.244623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea345f-9c9f-4976-82d1-847f91d0d254 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:49.244623 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea345f-9c9f-4976-82d1-847f91d0d254 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:49.245964 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 653/1293] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:49.251181 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65a32-c6d4-423c-b635-5c9fd68cf6bc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:49.251596 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65a32-c6d4-423c-b635-5c9fd68cf6bc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:49.251733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65a32-c6d4-423c-b635-5c9fd68cf6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:49.268343 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-85a65a32-c6d4-423c-b635-5c9fd68cf6bc None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:49.269533 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-85a65a32-c6d4-423c-b635-5c9fd68cf6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:49.298184 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:49.334286 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 641/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:49.356723 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea345f-9c9f-4976-82d1-847f91d0d254 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:49.387547 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:49.455944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea345f-9c9f-4976-82d1-847f91d0d254 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:49.488667 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69591945-105c-45dd-bf79-a2db59194b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:49.489313 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69591945-105c-45dd-bf79-a2db59194b92 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:49.489590 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69591945-105c-45dd-bf79-a2db59194b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:49.490438 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69591945-105c-45dd-bf79-a2db59194b92 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:49.491194 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69591945-105c-45dd-bf79-a2db59194b92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:49.492546 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69591945-105c-45dd-bf79-a2db59194b92 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:49.505118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 654/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:13:49 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:13:51.682091 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ebd6-ab04-4467-b573-85d397381c79 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:51.682602 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ebd6-ab04-4467-b573-85d397381c79 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:51.682702 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ebd6-ab04-4467-b573-85d397381c79 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:51.684031 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 642/1296] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:13:51.689268 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:51.689716 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:51.689818 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:51.706000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:51.707323 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:51.777550 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 655/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:51.799932 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ebd6-ab04-4467-b573-85d397381c79 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:51.898746 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ebd6-ab04-4467-b573-85d397381c79 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:51.931202 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:51.931977 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:51.932302 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:51.932522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:51.933163 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:51.934514 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:51.946053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:51.947203 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:51.948065 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 643/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:13:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:51.953143 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:51.971452 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:52.049657 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e70a2-2465-4ccb-90be-6408704c6606 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:52.081808 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:52.082451 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:52.082733 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:52.083034 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:52.084698 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:52.085148 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:52.086969 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:52.092159 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 656/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:13:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:52.097961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:52.129110 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:52.204186 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690437-1693-4986-a63e-6221ec65c233 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:52.237623 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:52.238277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:52.238559 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:52.238860 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:52.240279 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] RBAC: Adding query filter params (interface=public, service_id=ae07e6880d534a6f9c1a70ae58121059, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:52.240591 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:52.241959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9439797-875a-48e6-ad75-0686b3ea97ba None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:52.247195 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 644/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:13:52 2022] GET /identity/v3/endpoints?service_id=ae07e6880d534a6f9c1a70ae58121059&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:13:52.252535 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:52.342047 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:52.361335 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33324-a4ec-437e-b061-f303d4d56a4e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:52.394782 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26632471-0b9b-4d4d-86fb-47cf8b21bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:52.395464 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26632471-0b9b-4d4d-86fb-47cf8b21bfef None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:52.395743 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26632471-0b9b-4d4d-86fb-47cf8b21bfef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:52.396024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26632471-0b9b-4d4d-86fb-47cf8b21bfef None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:52.396703 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26632471-0b9b-4d4d-86fb-47cf8b21bfef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:52.398062 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26632471-0b9b-4d4d-86fb-47cf8b21bfef None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:52.404961 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 657/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:13:52 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:13:54.587620 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660ffa-051f-4549-81be-baae53d7b87b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:54.588141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660ffa-051f-4549-81be-baae53d7b87b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:54.588141 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660ffa-051f-4549-81be-baae53d7b87b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:54.589527 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 645/1302] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:13:54.594705 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:54.595168 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:54.595260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:54.612142 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:13:54.613311 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:13:54.679674 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 658/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:13:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:13:54.702410 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5660ffa-051f-4549-81be-baae53d7b87b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:54.793965 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:54.800725 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5660ffa-051f-4549-81be-baae53d7b87b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:54.834575 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:54.835392 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:54.835677 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:54.835953 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:54.836607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:54.837967 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:13:54.849618 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:13:54.850744 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: ERROR keystone.server.flask.application May 19 14:13:54.851947 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 646/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:13:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:13:54.856755 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:54.931646 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:13:54.954133 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14badb8-925f-49b3-be6f-a75811108fe3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:54.985843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:54.986488 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:54.986765 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:54.987066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:54.987758 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] RBAC: Adding query filter params (name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:13:54.988057 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:54.989939 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c8ab-eb30-4ad2-b2a3-472608a4bdac None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:54.995055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 659/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:13:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:13:55.000589 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:13:55.096325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f93812-286a-41f9-8655-483a77afa142 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:13:55.128400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb318d2-b6cd-4a9a-a358-10fac0a1a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630473ba96b4b308be7b0443882c517', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:13:55.129037 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb318d2-b6cd-4a9a-a358-10fac0a1a1e7 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:13:55.129315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb318d2-b6cd-4a9a-a358-10fac0a1a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:13:55.129586 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb318d2-b6cd-4a9a-a358-10fac0a1a1e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:13:55.131262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb318d2-b6cd-4a9a-a358-10fac0a1a1e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:13:55.134938 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb318d2-b6cd-4a9a-a358-10fac0a1a1e7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:13:55.154397 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 647/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:13:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:14:04.991950 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=30 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:14:05.150215 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:14:58.447968 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2bb4-0314-4755-84b8-1e3a57e2f354 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:14:58.448539 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2bb4-0314-4755-84b8-1e3a57e2f354 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:14:58.448539 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2bb4-0314-4755-84b8-1e3a57e2f354 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:14:58.449934 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 660/1307] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:14:58.455194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98811b8b-a287-4998-8795-9f7804029d23 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:14:58.455613 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98811b8b-a287-4998-8795-9f7804029d23 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:14:58.455806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98811b8b-a287-4998-8795-9f7804029d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:14:58.529369 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-98811b8b-a287-4998-8795-9f7804029d23 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:14:58.530587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-98811b8b-a287-4998-8795-9f7804029d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:14:58.637121 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 648/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:14:58.689753 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06edc43-eb39-43f8-989b-c1274730daa0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:14:58.690186 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06edc43-eb39-43f8-989b-c1274730daa0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:14:58.690637 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06edc43-eb39-43f8-989b-c1274730daa0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:14:58.693499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 661/1309] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:14:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:14:58.699680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7155fa1-482f-4c8f-9661-cbcd89fa3cf7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:14:58.699944 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7155fa1-482f-4c8f-9661-cbcd89fa3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:14:58.700206 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7155fa1-482f-4c8f-9661-cbcd89fa3cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:14:58.807926 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a7155fa1-482f-4c8f-9661-cbcd89fa3cf7 None None] MFA Rules not processed for user `942d20017757425787011a2b41dbb5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:14:58.809730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a7155fa1-482f-4c8f-9661-cbcd89fa3cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:14:58.841246 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:14:58.925916 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06edc43-eb39-43f8-989b-c1274730daa0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:14:58.928233 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e06edc43-eb39-43f8-989b-c1274730daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:14:58.933401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 649/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:14:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:14:59.066123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06edc43-eb39-43f8-989b-c1274730daa0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:14:59.149210 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:14:59.149934 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:14:59.150277 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:14:59.150674 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:14:59.152768 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:14:59.229419 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:14:59.292008 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:14:59.293716 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07838-9d72-4437-8b14-6a77bc953d68 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:14:59.316412 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 662/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 14:15:01.831226 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fd6f5-da67-4868-85e0-9311f6721183 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:01.831751 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fd6f5-da67-4868-85e0-9311f6721183 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:01.831846 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fd6f5-da67-4868-85e0-9311f6721183 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:01.833357 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 650/1312] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:01.838628 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc236-83ee-41df-aec4-0c0afa315875 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:01.839132 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc236-83ee-41df-aec4-0c0afa315875 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:01.839240 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc236-83ee-41df-aec4-0c0afa315875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:01.934613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-01bbc236-83ee-41df-aec4-0c0afa315875 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:01.935852 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-01bbc236-83ee-41df-aec4-0c0afa315875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:02.097469 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 663/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:02.135509 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fd6f5-da67-4868-85e0-9311f6721183 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:02.137058 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fb8fd6f5-da67-4868-85e0-9311f6721183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:02.246107 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fd6f5-da67-4868-85e0-9311f6721183 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:02.319780 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:02.323023 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:02.323766 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:02.324061 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:02.324737 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:02.326802 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:02.445681 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:02.447323 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbaca4-f206-43d7-8e38-50962963ac5d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:02.468973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 651/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:05.042762 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a968c-6291-4d51-87c0-018e1e2ecd43 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:05.043320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a968c-6291-4d51-87c0-018e1e2ecd43 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:05.043320 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a968c-6291-4d51-87c0-018e1e2ecd43 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:05.044707 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 664/1315] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:05.050101 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4e988-984a-4b0c-b430-6971d50f5947 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:05.051020 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4e988-984a-4b0c-b430-6971d50f5947 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:05.051224 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4e988-984a-4b0c-b430-6971d50f5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:05.114005 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d5f4e988-984a-4b0c-b430-6971d50f5947 None None] MFA Rules not processed for user `89914458b95048e68ebfaa2a619ef7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:05.115234 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d5f4e988-984a-4b0c-b430-6971d50f5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:05.166140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:05.211064 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 652/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:05.250571 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a968c-6291-4d51-87c0-018e1e2ecd43 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:05.252131 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5e2a968c-6291-4d51-87c0-018e1e2ecd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:05.262024 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:05.357145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a968c-6291-4d51-87c0-018e1e2ecd43 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:05.429957 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:05.430597 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:05.430907 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:05.431177 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:05.432791 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:05.493054 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:05.540478 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:05.541887 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c7e1-d31e-4a75-bd3e-190b2b58cdb2 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:05.559897 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 665/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:08.329822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfc846-91bb-4c98-8b47-5bcfc5ad4731 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:08.330387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfc846-91bb-4c98-8b47-5bcfc5ad4731 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:08.330387 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfc846-91bb-4c98-8b47-5bcfc5ad4731 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:08.331813 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 653/1318] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:08.337551 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b653a-a29e-4fe4-8f80-518dfc078d6a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:08.337952 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b653a-a29e-4fe4-8f80-518dfc078d6a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:08.338175 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b653a-a29e-4fe4-8f80-518dfc078d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:08.403435 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5b4b653a-a29e-4fe4-8f80-518dfc078d6a None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:08.404638 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5b4b653a-a29e-4fe4-8f80-518dfc078d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:08.498752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 666/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:08.549966 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98459-63ed-4fd6-8ef1-0eb23a958501 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:08.550814 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98459-63ed-4fd6-8ef1-0eb23a958501 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:08.551205 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98459-63ed-4fd6-8ef1-0eb23a958501 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:08.552592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 654/1320] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:08.558196 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d199-98f3-4870-a6a8-dc36f34f51bb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:08.558491 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d199-98f3-4870-a6a8-dc36f34f51bb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:08.558774 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d199-98f3-4870-a6a8-dc36f34f51bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:08.579965 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:08.633621 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f797d199-98f3-4870-a6a8-dc36f34f51bb None None] MFA Rules not processed for user `942d20017757425787011a2b41dbb5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:08.634843 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f797d199-98f3-4870-a6a8-dc36f34f51bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:08.708385 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 667/1321] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:08.717255 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98459-63ed-4fd6-8ef1-0eb23a958501 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:08.718822 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-85d98459-63ed-4fd6-8ef1-0eb23a958501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:08.820430 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98459-63ed-4fd6-8ef1-0eb23a958501 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:08.891355 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:08.891924 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:08.892207 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:08.892482 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:08.894667 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:08.902007 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:09.001490 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:09.002973 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6469638-d3fb-4d65-9a56-dbb75472550c service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:09.021608 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 655/1322] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:12.375522 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543a46-f5a6-493b-8498-4b954f88db13 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:12.376060 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543a46-f5a6-493b-8498-4b954f88db13 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:12.376060 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543a46-f5a6-493b-8498-4b954f88db13 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:12.377639 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 668/1323] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:12.383969 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fa641-5247-4883-bace-9ac7c4a97f39 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:12.384409 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fa641-5247-4883-bace-9ac7c4a97f39 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:12.384530 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fa641-5247-4883-bace-9ac7c4a97f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:12.452418 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8a5fa641-5247-4883-bace-9ac7c4a97f39 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:12.453631 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8a5fa641-5247-4883-bace-9ac7c4a97f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:12.510903 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:12.550640 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 656/1324] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:12.586370 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543a46-f5a6-493b-8498-4b954f88db13 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:12.587942 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b9543a46-f5a6-493b-8498-4b954f88db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:12.701632 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543a46-f5a6-493b-8498-4b954f88db13 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:12.714974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:12.777144 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:12.777784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:12.778060 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:12.778329 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:12.779978 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:12.892752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:12.894272 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39b40d-c28c-4be2-bb04-561e18b2fa62 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:12.918445 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 669/1325] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:15.180471 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c35944-5557-4be3-bf89-09561dcee80b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:15.181053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c35944-5557-4be3-bf89-09561dcee80b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:15.181053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c35944-5557-4be3-bf89-09561dcee80b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:15.182420 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 657/1326] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:15.187885 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31575-57a7-4464-98b0-9ba7b18a56c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:15.188296 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31575-57a7-4464-98b0-9ba7b18a56c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:15.188436 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31575-57a7-4464-98b0-9ba7b18a56c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:15.234659 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:15.254169 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-01d31575-57a7-4464-98b0-9ba7b18a56c4 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:15.255391 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-01d31575-57a7-4464-98b0-9ba7b18a56c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:15.369880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 670/1327] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:15.405845 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c35944-5557-4be3-bf89-09561dcee80b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:15.407523 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-59c35944-5557-4be3-bf89-09561dcee80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:15.525920 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c35944-5557-4be3-bf89-09561dcee80b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:15.601177 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:15.601833 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:15.602120 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:15.602392 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:15.604140 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:15.621448 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:15.720399 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:15.721827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc4275-0cd5-4120-8150-fde8e87aba88 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:15.740475 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 658/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:18.010640 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18fc4-0343-45db-a7d7-000f0ed0d0fa None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:18.011275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18fc4-0343-45db-a7d7-000f0ed0d0fa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:18.011275 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18fc4-0343-45db-a7d7-000f0ed0d0fa None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:18.012598 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 671/1329] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:18.018004 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749842c-13e8-49a6-9962-3b2119100dff None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:18.018451 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749842c-13e8-49a6-9962-3b2119100dff None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:18.018553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749842c-13e8-49a6-9962-3b2119100dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:18.085878 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8749842c-13e8-49a6-9962-3b2119100dff None None] MFA Rules not processed for user `89914458b95048e68ebfaa2a619ef7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:18.087277 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8749842c-13e8-49a6-9962-3b2119100dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:18.152519 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:18.186564 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 659/1330] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:18.223481 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18fc4-0343-45db-a7d7-000f0ed0d0fa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:18.225099 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-88e18fc4-0343-45db-a7d7-000f0ed0d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:18.339342 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18fc4-0343-45db-a7d7-000f0ed0d0fa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:18.358800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:18.415394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:18.416053 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:18.416337 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:18.416610 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:18.418260 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:18.525377 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:18.526823 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d73654-5007-486d-bd10-e1620d209516 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:18.544941 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 672/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:20.986522 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33e648-13ed-469e-8182-8516fd1deff6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:20.987071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33e648-13ed-469e-8182-8516fd1deff6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:20.987071 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33e648-13ed-469e-8182-8516fd1deff6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:20.988961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 660/1332] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:20.994612 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268274-c73f-4010-b06c-4141f0558ae4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:20.995145 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268274-c73f-4010-b06c-4141f0558ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:20.995340 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268274-c73f-4010-b06c-4141f0558ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:21.063613 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:21.067331 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b9268274-c73f-4010-b06c-4141f0558ae4 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:21.069123 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b9268274-c73f-4010-b06c-4141f0558ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:21.166055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 673/1333] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:21.202877 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33e648-13ed-469e-8182-8516fd1deff6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:21.204374 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ee33e648-13ed-469e-8182-8516fd1deff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:21.307022 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33e648-13ed-469e-8182-8516fd1deff6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:21.380075 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:21.380730 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:21.381011 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:21.381284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:21.382974 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:21.412262 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:21.493617 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:21.495108 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5a775-d2d4-4942-bde3-7519c15b1e45 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:21.513017 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 661/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:23.817675 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ba2c-3a32-4d1a-a7ed-db35609c361d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:23.818229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ba2c-3a32-4d1a-a7ed-db35609c361d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:23.818229 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ba2c-3a32-4d1a-a7ed-db35609c361d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:23.819670 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 674/1335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:23.825105 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce09b4-43ae-4f4a-85b6-0f0500e5f493 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:23.825545 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce09b4-43ae-4f4a-85b6-0f0500e5f493 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:23.825679 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce09b4-43ae-4f4a-85b6-0f0500e5f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:23.890334 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-17ce09b4-43ae-4f4a-85b6-0f0500e5f493 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:23.891587 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-17ce09b4-43ae-4f4a-85b6-0f0500e5f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:23.966040 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:23.988972 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 662/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:24.028650 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ba2c-3a32-4d1a-a7ed-db35609c361d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:24.030170 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3a96ba2c-3a32-4d1a-a7ed-db35609c361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:24.132622 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ba2c-3a32-4d1a-a7ed-db35609c361d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:24.163943 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:24.209141 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:24.209788 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:24.210066 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:24.210339 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:24.212010 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:24.318433 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:24.319790 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedaad0-1430-40fa-83b7-b87434afca21 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:24.337877 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 675/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:26.913213 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9418eb-049e-4b40-85b9-77247019d6fc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:26.913753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9418eb-049e-4b40-85b9-77247019d6fc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:26.913753 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9418eb-049e-4b40-85b9-77247019d6fc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:26.915165 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 663/1338] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:26.920413 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7271af-5626-421b-925f-b101a631007d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:26.920800 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7271af-5626-421b-925f-b101a631007d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:26.920992 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7271af-5626-421b-925f-b101a631007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:26.983624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0b7271af-5626-421b-925f-b101a631007d None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:26.984811 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0b7271af-5626-421b-925f-b101a631007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:26.993322 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:27.080832 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 676/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:27.116334 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9418eb-049e-4b40-85b9-77247019d6fc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:27.117875 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8c9418eb-049e-4b40-85b9-77247019d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:27.224282 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9418eb-049e-4b40-85b9-77247019d6fc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:27.298356 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:27.299030 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:27.299315 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:27.299590 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:27.301259 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:27.336716 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:27.411301 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:27.412750 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a69d52-035b-4e2e-995a-dc37df575c97 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:27.431130 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 664/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:31.634026 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e93260-6465-4c85-8ab9-9a00f57a25a6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:31.634536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e93260-6465-4c85-8ab9-9a00f57a25a6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:31.634536 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e93260-6465-4c85-8ab9-9a00f57a25a6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:31.635966 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 677/1341] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:31.641401 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4800-2bb4-47cd-8a71-ee04f8c41aa0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:31.641843 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4800-2bb4-47cd-8a71-ee04f8c41aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:31.641939 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4800-2bb4-47cd-8a71-ee04f8c41aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:31.712078 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-acfc4800-2bb4-47cd-8a71-ee04f8c41aa0 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:31.713258 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-acfc4800-2bb4-47cd-8a71-ee04f8c41aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:31.803352 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:31.817558 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 665/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:31.855660 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e93260-6465-4c85-8ab9-9a00f57a25a6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:31.857784 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-35e93260-6465-4c85-8ab9-9a00f57a25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:31.960929 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e93260-6465-4c85-8ab9-9a00f57a25a6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:31.964793 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975cc8-b161-448d-a8e3-68e663cc362d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:31.965468 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975cc8-b161-448d-a8e3-68e663cc362d service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:31.965752 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975cc8-b161-448d-a8e3-68e663cc362d service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:31.966027 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975cc8-b161-448d-a8e3-68e663cc362d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:31.975209 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e975cc8-b161-448d-a8e3-68e663cc362d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:31.976624 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e975cc8-b161-448d-a8e3-68e663cc362d service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:31.986089 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 678/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:34.939024 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681095e-0361-4d68-8cce-f7ccee15479f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:34.939553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681095e-0361-4d68-8cce-f7ccee15479f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:34.939553 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681095e-0361-4d68-8cce-f7ccee15479f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:34.940978 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 666/1344] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:34.946945 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a64eab-a467-44ee-8b6d-e003fa7afabc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:34.947376 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a64eab-a467-44ee-8b6d-e003fa7afabc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:34.947499 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a64eab-a467-44ee-8b6d-e003fa7afabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:34.975408 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-50a64eab-a467-44ee-8b6d-e003fa7afabc None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:34.976583 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-50a64eab-a467-44ee-8b6d-e003fa7afabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:35.003935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:35.053216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 679/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:35.089801 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681095e-0361-4d68-8cce-f7ccee15479f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:35.091505 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a681095e-0361-4d68-8cce-f7ccee15479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:35.104636 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681095e-0361-4d68-8cce-f7ccee15479f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:35.108173 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cc420-ab3b-429a-bec1-20ed230c9c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:35.108841 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc420-ab3b-429a-bec1-20ed230c9c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:35.109124 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc420-ab3b-429a-bec1-20ed230c9c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:35.109400 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc420-ab3b-429a-bec1-20ed230c9c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:35.119329 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc420-ab3b-429a-bec1-20ed230c9c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:35.120764 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc420-ab3b-429a-bec1-20ed230c9c93 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:35.131054 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 667/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:39.268008 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78fea-1810-43ef-8377-037691f0415a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:39.268555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78fea-1810-43ef-8377-037691f0415a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:39.268555 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78fea-1810-43ef-8377-037691f0415a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:39.270032 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 680/1347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:39.276080 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80137e-31eb-4cd7-b548-2eeb04dbcc01 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:39.276548 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80137e-31eb-4cd7-b548-2eeb04dbcc01 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:39.276655 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80137e-31eb-4cd7-b548-2eeb04dbcc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:39.296447 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bd80137e-31eb-4cd7-b548-2eeb04dbcc01 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:39.297650 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bd80137e-31eb-4cd7-b548-2eeb04dbcc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:39.305743 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 668/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:39.348594 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78fea-1810-43ef-8377-037691f0415a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:39.359968 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78fea-1810-43ef-8377-037691f0415a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:39.363487 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c29d-8bf8-4d20-8c14-3e559231cb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942d20017757425787011a2b41dbb5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:39.364156 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c29d-8bf8-4d20-8c14-3e559231cb14 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:39.364443 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c29d-8bf8-4d20-8c14-3e559231cb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:39.364745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c29d-8bf8-4d20-8c14-3e559231cb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:39.374483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c29d-8bf8-4d20-8c14-3e559231cb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:39.375944 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c29d-8bf8-4d20-8c14-3e559231cb14 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:39.386244 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 681/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:44.697989 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d9179-e82c-4846-b39b-66d58c6fd10d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:44.698959 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d9179-e82c-4846-b39b-66d58c6fd10d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:44.699458 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d9179-e82c-4846-b39b-66d58c6fd10d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:44.701278 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 669/1350] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:44.708002 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e7cb-f076-4e7a-9ad6-6381a7f2fe58 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:44.708415 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e7cb-f076-4e7a-9ad6-6381a7f2fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:44.708604 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e7cb-f076-4e7a-9ad6-6381a7f2fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:44.856073 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a175e7cb-f076-4e7a-9ad6-6381a7f2fe58 None None] MFA Rules not processed for user `e31c89ce187140a4912cbf9536b480fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:44.859665 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a175e7cb-f076-4e7a-9ad6-6381a7f2fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:45.051088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 682/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:49.172118 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acdfd2-c008-41f8-8436-55db3a369aa5 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:49.172657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acdfd2-c008-41f8-8436-55db3a369aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:49.172657 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acdfd2-c008-41f8-8436-55db3a369aa5 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:49.174187 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 670/1352] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:49.180023 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09754d-60c9-4dde-b447-88cbbd2fe9c7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:49.180534 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09754d-60c9-4dde-b447-88cbbd2fe9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:49.180625 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09754d-60c9-4dde-b447-88cbbd2fe9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:49.200254 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2f09754d-60c9-4dde-b447-88cbbd2fe9c7 None None] MFA Rules not processed for user `e31c89ce187140a4912cbf9536b480fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:49.201794 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2f09754d-60c9-4dde-b447-88cbbd2fe9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:49.210373 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 683/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:49.291305 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=13 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:50.802491 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2eb5-09a8-4e1e-a906-e28976d7137a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:50.803193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2eb5-09a8-4e1e-a906-e28976d7137a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:50.803193 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2eb5-09a8-4e1e-a906-e28976d7137a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:50.804699 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 671/1354] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:50.811483 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2afb5-82c7-4133-8814-593c09948dcb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:50.812000 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2afb5-82c7-4133-8814-593c09948dcb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:50.812192 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2afb5-82c7-4133-8814-593c09948dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:50.842974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-50d2afb5-82c7-4133-8814-593c09948dcb None None] MFA Rules not processed for user `e31c89ce187140a4912cbf9536b480fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:50.844171 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-50d2afb5-82c7-4133-8814-593c09948dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:50.853152 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 684/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:15:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:54.704353 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eb742-7b0d-4a66-af5c-4b76f4ab2e9e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:54.704885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eb742-7b0d-4a66-af5c-4b76f4ab2e9e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:54.704885 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eb742-7b0d-4a66-af5c-4b76f4ab2e9e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:54.706266 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 672/1356] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:54.712001 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3335-9b4b-4cda-800f-55c72d432e08 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:54.712405 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3335-9b4b-4cda-800f-55c72d432e08 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:54.712563 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3335-9b4b-4cda-800f-55c72d432e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:54.731252 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d37e3335-9b4b-4cda-800f-55c72d432e08 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:54.732441 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d37e3335-9b4b-4cda-800f-55c72d432e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:54.740539 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 685/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:54.796647 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b2cd4-4328-48b7-86ba-51938b6ced76 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:54.797122 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b2cd4-4328-48b7-86ba-51938b6ced76 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:54.797741 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b2cd4-4328-48b7-86ba-51938b6ced76 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:54.799727 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 673/1358] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:54.807513 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14099-1d2f-4d9b-a8d3-7640d844d63b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:54.808129 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14099-1d2f-4d9b-a8d3-7640d844d63b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:54.808684 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14099-1d2f-4d9b-a8d3-7640d844d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:54.869493 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:15:54.887394 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fcd14099-1d2f-4d9b-a8d3-7640d844d63b None None] MFA Rules not processed for user `ff0e8e8eafa44aa294538c43527190d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:54.888785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fcd14099-1d2f-4d9b-a8d3-7640d844d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:54.973856 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 686/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:15:54.982462 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b2cd4-4328-48b7-86ba-51938b6ced76 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:54.997607 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b2cd4-4328-48b7-86ba-51938b6ced76 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:55.003310 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe3cf-4a3d-4210-8933-389a02cc5225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e8e8eafa44aa294538c43527190d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:55.004053 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe3cf-4a3d-4210-8933-389a02cc5225 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:55.004473 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe3cf-4a3d-4210-8933-389a02cc5225 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:55.005619 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe3cf-4a3d-4210-8933-389a02cc5225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:55.015541 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbe3cf-4a3d-4210-8933-389a02cc5225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:55.017361 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbe3cf-4a3d-4210-8933-389a02cc5225 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:55.028792 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 674/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:15:57.481991 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89482d7f-e13e-4197-8931-db731e069029 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:57.482509 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89482d7f-e13e-4197-8931-db731e069029 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:57.483081 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89482d7f-e13e-4197-8931-db731e069029 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:57.484316 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 687/1361] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:15:57.489913 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc1a35-1254-4340-9b19-ca077dcc60f0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:57.490348 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc1a35-1254-4340-9b19-ca077dcc60f0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:57.490624 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc1a35-1254-4340-9b19-ca077dcc60f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:57.509733 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-55fc1a35-1254-4340-9b19-ca077dcc60f0 None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:15:57.510961 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-55fc1a35-1254-4340-9b19-ca077dcc60f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:15:57.518650 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 675/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:15:57.563234 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89482d7f-e13e-4197-8931-db731e069029 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:15:57.578594 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89482d7f-e13e-4197-8931-db731e069029 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:15:57.584388 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4c387-b6ee-466c-9dd7-1f6dfad630d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e8e8eafa44aa294538c43527190d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:15:57.585118 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4c387-b6ee-466c-9dd7-1f6dfad630d3 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:15:57.585399 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4c387-b6ee-466c-9dd7-1f6dfad630d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:15:57.585674 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4c387-b6ee-466c-9dd7-1f6dfad630d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:15:57.594398 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4c387-b6ee-466c-9dd7-1f6dfad630d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:15:57.595935 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4c387-b6ee-466c-9dd7-1f6dfad630d3 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:15:57.606529 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 688/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:16:00.153389 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77936-00e5-4654-be77-cfb8ae6fb70b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:00.153979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77936-00e5-4654-be77-cfb8ae6fb70b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:00.153979 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77936-00e5-4654-be77-cfb8ae6fb70b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:00.155384 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 676/1364] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:16:00.160585 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b492-7f2a-4b00-9195-6a30d01b019e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:00.161539 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b492-7f2a-4b00-9195-6a30d01b019e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:00.161681 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b492-7f2a-4b00-9195-6a30d01b019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:00.180880 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-43a5b492-7f2a-4b00-9195-6a30d01b019e None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:16:00.182088 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-43a5b492-7f2a-4b00-9195-6a30d01b019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:16:00.190216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 689/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:16:00.235585 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de72826-e584-4591-a10a-19dec68133ad None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:00.235955 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de72826-e584-4591-a10a-19dec68133ad None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:00.236311 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de72826-e584-4591-a10a-19dec68133ad None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:00.237784 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 677/1366] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:16:00.243626 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51103814-0995-47eb-a484-709846f467c8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:00.243914 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51103814-0995-47eb-a484-709846f467c8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:00.244188 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51103814-0995-47eb-a484-709846f467c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:00.262974 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-51103814-0995-47eb-a484-709846f467c8 None None] MFA Rules not processed for user `ff0e8e8eafa44aa294538c43527190d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:16:00.264203 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-51103814-0995-47eb-a484-709846f467c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:16:00.275475 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 690/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:16:00.301284 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de72826-e584-4591-a10a-19dec68133ad None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:16:00.323627 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de72826-e584-4591-a10a-19dec68133ad None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:16:00.330196 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139efd-1e17-4c84-a107-ca7b95d30f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e8e8eafa44aa294538c43527190d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:16:00.331225 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139efd-1e17-4c84-a107-ca7b95d30f85 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:00.331731 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139efd-1e17-4c84-a107-ca7b95d30f85 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:00.332194 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139efd-1e17-4c84-a107-ca7b95d30f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:00.342950 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139efd-1e17-4c84-a107-ca7b95d30f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:16:00.345094 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139efd-1e17-4c84-a107-ca7b95d30f85 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:16:00.359146 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 678/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:16:01.035929 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df027a4-6ede-4e17-adc1-d6a9a2fd9dd8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:01.036849 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df027a4-6ede-4e17-adc1-d6a9a2fd9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:01.037055 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df027a4-6ede-4e17-adc1-d6a9a2fd9dd8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:01.038565 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 691/1369] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:16:01.043895 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f89f-808a-4cfe-ae65-49f122c0af0f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:01.044293 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f89f-808a-4cfe-ae65-49f122c0af0f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:01.044708 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f89f-808a-4cfe-ae65-49f122c0af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:01.064461 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9ca2f89f-808a-4cfe-ae65-49f122c0af0f None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:16:01.065806 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9ca2f89f-808a-4cfe-ae65-49f122c0af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:16:01.075680 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 679/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:16:02.679386 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445a84-2918-4542-96ae-73c976aa4b6f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:02.679894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445a84-2918-4542-96ae-73c976aa4b6f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:02.679894 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445a84-2918-4542-96ae-73c976aa4b6f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:02.681216 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 692/1371] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:16:02.686661 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad323fd-9041-487e-8853-d783a479421b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:02.687112 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad323fd-9041-487e-8853-d783a479421b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:02.687325 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad323fd-9041-487e-8853-d783a479421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:02.705738 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dad323fd-9041-487e-8853-d783a479421b None None] MFA Rules not processed for user `1630473ba96b4b308be7b0443882c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:16:02.706984 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dad323fd-9041-487e-8853-d783a479421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:16:02.715367 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 680/1372] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:16:02.759785 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445a84-2918-4542-96ae-73c976aa4b6f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:16:02.774465 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445a84-2918-4542-96ae-73c976aa4b6f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:16:02.779836 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e107-85cc-42e7-868a-9a44fbac5af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e8e8eafa44aa294538c43527190d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f78edebdfaab4204a54167b2bcc034af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:16:02.780466 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e107-85cc-42e7-868a-9a44fbac5af9 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:16:02.780745 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e107-85cc-42e7-868a-9a44fbac5af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:16:02.781017 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e107-85cc-42e7-868a-9a44fbac5af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:16:02.790120 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907e107-85cc-42e7-868a-9a44fbac5af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:16:02.791706 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907e107-85cc-42e7-868a-9a44fbac5af9 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:16:02.800959 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 693/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:16:12.699827 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=21 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:16:12.796863 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=54 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:16:24.826881 dv-cinder-788367-10-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 19 14:16:24.827112 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: Thu May 19 14:16:24 2022 - graceful shutdown triggered... May 19 14:16:24.827592 dv-cinder-788367-10-iscsi devstack@keystone.service[80246]: Gracefully killing worker 1 (pid: 80246)... May 19 14:16:24.827967 dv-cinder-788367-10-iscsi devstack@keystone.service[80247]: Gracefully killing worker 2 (pid: 80247)... May 19 14:16:25.828541 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: worker 1 buried after 1 seconds May 19 14:16:25.828541 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: worker 2 buried after 1 seconds May 19 14:16:25.828541 dv-cinder-788367-10-iscsi devstack@keystone.service[80233]: goodbye to uWSGI. May 19 14:16:25.830105 dv-cinder-788367-10-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 19 14:16:25.830664 dv-cinder-788367-10-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 19 14:22:18.223130 dv-cinder-788367-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 14:22:18.232350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 14:22:18 2022] *** May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: nodename: dv-cinder-788367-10-iscsi May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: machine: x86_64 May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: clock source: unix May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: pcre jit disabled May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: detected number of CPU cores: 4 May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: current working directory: / May 19 14:22:18.234350 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: detected binary path: /usr/bin/uwsgi-core May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: your processes number limit is 47680 May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: your memory page size is 4096 bytes May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: detected max file descriptor number: 2048 May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: lock engine: pthread robust mutexes May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: thunder lock: enabled May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 14:22:18.235032 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 14:22:18.279923 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: Python main interpreter initialized at 0x5634251c79c0 May 19 14:22:18.279923 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: python threads support enabled May 19 14:22:18.279923 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: your server socket listen backlog is limited to 100 connections May 19 14:22:18.279923 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: your mercy for graceful operations on workers is 90 seconds May 19 14:22:18.280312 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: mapped 403077 bytes (393 KB) for 2 cores May 19 14:22:18.280393 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: *** Operational MODE: preforking *** May 19 14:22:18.280605 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: *** uWSGI is running in multiple interpreter mode *** May 19 14:22:18.280605 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: spawned uWSGI master process (pid: 143642) May 19 14:22:18.280801 dv-cinder-788367-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 14:22:18.281566 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: spawned uWSGI worker 1 (pid: 143652, cores: 1) May 19 14:22:18.286811 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: spawned uWSGI worker 2 (pid: 143653, cores: 1) May 19 14:22:18.286811 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 14:22:24.001247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:22:24.001247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: from cryptography.utils import int_from_bytes May 19 14:22:24.002425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:22:24.002425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: from cryptography.utils import int_from_bytes May 19 14:22:24.035373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:22:24.035373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: from cryptography.utils import int_from_bytes May 19 14:22:24.036022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:22:24.036022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: from cryptography.utils import int_from_bytes May 19 14:22:24.051970 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:22:24.052162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:22:24.052354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] command line args: [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:22:24.052622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:22:24.052800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ================================================================================ {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:22:24.053056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] admin_token = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.053303 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] config_dir = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.053489 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.053673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] config_source = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.053863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] debug = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.054041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.054529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.054668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] insecure_debug = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.054830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.055087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.055321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.055500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_config_append = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.055679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.055901 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_dir = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.056034 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_file = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.056249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.056496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.056741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.056985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.057163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.057339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.057582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.057827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.058063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.058295 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.058528 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.058760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.059082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.059404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] notification_format = cadf {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.059683 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.060172 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.060358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] publish_errors = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.060596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.060830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.061012 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.061260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.061499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.061733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] standard_threads = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.061962 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] strict_password_check = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.062206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.062382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] use_eventlog = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.062558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] use_journal = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.062734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] use_json = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.062936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] use_stderr = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.063111 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] use_syslog = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.063342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] watch_log_file = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.063598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.063834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.064093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.064332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.064582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.064824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.065072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.065308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.065556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.065804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.066054 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.066289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.066904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.067153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.067405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.067655 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.067894 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.068153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.068408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.068657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.068894 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.069148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.069410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.069665 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.069914 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.070146 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.070376 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.070606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.070863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.071114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.071368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.071598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.071829 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.072077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.072323 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.072563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.072812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.073043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.073278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.073513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.073744 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.073974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.074204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.074434 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.074715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.075069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.075306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.075545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.075779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.076016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.076251 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.076499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.076729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.076967 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.077203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.077438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.077673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.077906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.078136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.078385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.078622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.078886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.079120 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.079378 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.079613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.079844 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.080080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.080314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.080581 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.080818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.081065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.081315 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.081552 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.081787 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.082020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.082269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.enabled = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.082505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.082741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.083020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.083216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:22:24.083325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.083419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:22:24.083505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.083598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] command line args: [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:22:24.083684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.083874 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:22:24.083967 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.084053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ================================================================================ {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:22:24.084169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.084307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] admin_token = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.084408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.084555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] config_dir = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.084664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.084751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.084836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.084947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] config_source = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.085068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.085169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] debug = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.085286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.085402 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.085528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.085633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.085726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] insecure_debug = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.085828 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.085952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.086055 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.086199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.086298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.086429 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.086527 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.086628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_config_append = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.086723 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.086854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.086949 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.087036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_dir = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.087125 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.087226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_file = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.087349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.087452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.087585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.087696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.087831 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.087939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.088067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.088175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.088274 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.088411 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.088503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.088659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.088762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.088906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.089007 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.089137 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.external = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.089237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.089370 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.089565 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.mapped = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.089668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.089769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.089862 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.089947 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.090065 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.090176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.password = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.090902 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] notification_format = cadf {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.091028 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] auth.token = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.091129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.091223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.091413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] catalog.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.091623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.091719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.091805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] publish_errors = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.091889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.092031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.092138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.092266 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.092360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.092445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.092583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.092687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.092822 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.092916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.093070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.093170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] standard_threads = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.093319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.093412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] strict_password_check = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.093568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.093662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.093769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] use_eventlog = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.093872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.093960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] use_journal = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.094044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.094137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] use_json = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.094257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.094351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] use_stderr = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.094450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] use_syslog = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.094535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.094667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] watch_log_file = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:22:24.094769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.094958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095066 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095184 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.095935 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096178 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096431 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096766 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097272 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097547 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.097976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098113 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.098966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099097 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099674 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099826 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.099920 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100165 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.100906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101137 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101381 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101507 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101607 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101746 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101846 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.101998 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102230 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.102968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103691 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103789 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.103924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104028 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104165 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.104880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.105824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.106568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.106677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.106773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.106930 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107258 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107638 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.107891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108463 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108841 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.108935 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109183 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.password = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.109880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110015 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.110846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111177 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111575 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111687 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111794 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.111940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112174 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112746 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.112975 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113445 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.enabled = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113822 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.113925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114761 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.114927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115239 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115700 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.115944 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116050 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116189 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116433 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116525 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.116917 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117847 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.117948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118179 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118401 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118779 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.118902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] policy.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119872 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.119994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] receipt.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120473 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.external = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.mapped = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.120953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.password = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] auth.token = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.121959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] catalog.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122461 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122700 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122871 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.122982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] revoke.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.123951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] role.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] role.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124328 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] role.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] role.list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.124897 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125049 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125630 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125775 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.125869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126266 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126370 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.126742 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127530 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.127879 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128019 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128121 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128653 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.128995 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129253 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129650 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.129988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130470 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130861 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.130962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131091 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131322 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131425 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131802 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.131886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132152 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132373 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.132981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133085 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133216 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.provider = fernet {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133693 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.133942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134768 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.134937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] trust.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.135971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136352 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.136917 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.connection = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137704 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.137953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138659 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138839 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.138948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.password = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139792 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.139886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140265 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140607 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.140978 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141538 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141776 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.141874 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:22:24.141967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.142161 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.142399 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.142637 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.142901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.143137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.143377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.143637 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.143872 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.144121 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.144370 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.144618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.144854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.145086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.145323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.145560 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.145797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.146029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.146275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.146521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.146768 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.147038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.147286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.147519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.147766 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.148004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.148242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.148478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.148714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.148960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.149207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.149446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.149701 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] policy.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.149935 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.150179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.150435 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.150673 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] receipt.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.150942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.151192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.151437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.151670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.151910 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.152163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.152416 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.152682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.153442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.153714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.153950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.154187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] revoke.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.154435 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.154676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.154949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] role.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.155190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] role.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.155439 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] role.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.155675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] role.list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.155927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.156176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.156428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.156678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.156928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.157175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.157424 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.157675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.157911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.158160 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.158409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.158659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.158934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.159334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.159574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.159828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.160080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.160330 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.160582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.160820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.161076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.161330 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.161570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.161803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.162038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.162270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.162524 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.162810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.163059 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.163308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.163548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.163783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.164023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.164262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.164513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.provider = fernet {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.164755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.165014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.165263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.165503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.165750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.165995 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.166244 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] trust.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.166484 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.166726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.166990 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.167242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.167492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.167726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.167970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.168276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.169093 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.connection = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.169342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.169593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.169833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.170077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.170314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.170553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.170820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.171045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.171291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.171530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.171774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.172024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.172276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.172516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.172777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.173017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.173241 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.173478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:22:24.173583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.173686 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:22:24.173781 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.173935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.182653 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.198629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.198892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.199123 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.209218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.211198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.211432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.228371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.228608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.265774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.267829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.317325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.317558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.318109 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.318351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.383544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.383702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.383883 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.383985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384334 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384641 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.384984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.407618 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.407884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408341 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408530 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408787 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.408965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.409065 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.409154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.420574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.420804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.433235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.433470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.433694 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.433934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.434692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.434934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.435150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.435619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.435853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.436077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.436300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.436519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.436736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.436951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:22:24.452280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.452395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.452499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:22:24.452589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:22:24.452825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.452933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.453031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:22:24.453127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:22:24.453293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.453391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.453557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.453719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.453858 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.453950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.454037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.454141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.465016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.465352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.465622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.465901 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.466820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.467105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.467380 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.467661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.473995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.475757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.477266 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.477547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.477830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.478217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.478501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.478764 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.479150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479434 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479702 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.479992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.480140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.480279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.480546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.481355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.481632 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.481908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.482189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.482460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.508000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.509591 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.509797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.509891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.511471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.511755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.515140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.515418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.515697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.517107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.517406 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.517683 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.522936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.523218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.525053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.525337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.527818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.528109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.528389 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.528667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.528939 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.529211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.529479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.529747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.529987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.530278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.530563 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.530866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.531142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.531416 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.531685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.531955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.548752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.549026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.551015 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.551298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.553506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.555809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.557100 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.557390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.560001 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.560294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.562937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.565221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.566452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.568779 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.570184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.570482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.570767 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.571079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.571352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.571633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.572514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.572817 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.573106 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.573407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.573665 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.573949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.590391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.590767 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.591059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.591324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.592924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.593304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.593577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.593858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.599192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.600908 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.601184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.601746 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.603484 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.603764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.604236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.604517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.604809 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.605088 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.605360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.607334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.607625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.607915 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.608211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.608488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.619406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.619686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.619965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.620255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.620540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.620825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.621101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.622350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.622948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.623235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.623520 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.623797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.624073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.640581 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.642818 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.643780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.646054 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.647068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.648661 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.649366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.650358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.650648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.650955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.651051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.652635 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.653483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.653768 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.658864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.660474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.661186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.662815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.663691 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.663980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.664269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.664549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.666035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.666333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.666621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.666932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.673830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.674175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.674458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.676103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.676393 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.676676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.682283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=143652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.682562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.682871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.683150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.683429 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.683713 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.684041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.684313 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.684597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.684747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=143653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:22:24.684863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685030 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.685977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=143652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.686144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.686426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.686703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.686999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.687279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.687561 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.687829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.688094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.688362 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=143653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:22:24.725562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634251c79c0 pid: 143652 (default app) May 19 14:22:24.727709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634251c79c0 pid: 143653 (default app) May 19 14:22:24.728901 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb677215-6068-4b79-8690-5433944c0c1f None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:24.729208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb677215-6068-4b79-8690-5433944c0c1f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:24.729492 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb677215-6068-4b79-8690-5433944c0c1f None None] PATH_INFO: `/v3` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:24.733751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu May 19 14:22:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:32.795899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:32.796530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:32.796530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:32.800782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:32.806224 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:32.806660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:32.806808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:32.875518 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: INFO dbcounter [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] Registered counter for database keystone May 19 14:22:32.897474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG oslo_db.sqlalchemy.engines [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:22:32.904253 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writer thread running {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:22:33.078692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG passlib.handlers.bcrypt [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=143652) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:22:33.079051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG passlib.handlers.bcrypt [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=143652) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:22:33.134586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:33.136236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:33.260750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 14:22:33.283960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:33.351624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: INFO dbcounter [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] Registered counter for database keystone May 19 14:22:33.371470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:22:33.377934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writer thread running {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:22:33.496382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab83852-c188-41bf-897c-89d76ed17664 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:33.500647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b820082b0b41198dbb6712a90e71d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:33.501304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:33.501847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:33.502125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:33.510136 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:33.561075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:22:33.561415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026c611-d527-4750-b4ff-df542f849fa7 admin admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:33.570813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:22:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:22:33.577292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:33.592416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0d79-a38c-4542-95df-78a7d8bb9112 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:33.596946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b820082b0b41198dbb6712a90e71d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:33.598082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:33.598374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:33.598671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] PATH_INFO: `/v3/projects/a9b820082b0b41198dbb6712a90e71d2` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:33.600267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] RBAC: Authorizing `identity:get_project(project_id=a9b820082b0b41198dbb6712a90e71d2)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:33.763064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:22:33.763411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d551111-15c4-4437-b18a-71d1c06f104a admin admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:33.768162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu May 19 14:22:33 2022] GET /identity/v3/projects/a9b820082b0b41198dbb6712a90e71d2 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:35.970190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fe08a-a3b9-48d5-a19b-487cc4689565 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:35.970743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fe08a-a3b9-48d5-a19b-487cc4689565 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:35.970743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fe08a-a3b9-48d5-a19b-487cc4689565 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:35.974954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:22:35.981048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:35.981481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:35.981587 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:36.000470 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:36.002276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:36.010197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 14:22:36.033021 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fe08a-a3b9-48d5-a19b-487cc4689565 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:36.045653 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fe08a-a3b9-48d5-a19b-487cc4689565 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:36.049893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677a73-6c94-4ea7-8789-039e60437632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b820082b0b41198dbb6712a90e71d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:36.050529 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677a73-6c94-4ea7-8789-039e60437632 admin admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:36.050841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677a73-6c94-4ea7-8789-039e60437632 admin admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:36.051126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677a73-6c94-4ea7-8789-039e60437632 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:36.059354 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677a73-6c94-4ea7-8789-039e60437632 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:36.061119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677a73-6c94-4ea7-8789-039e60437632 admin admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:36.069852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:22:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:22:36.075889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:36.084780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3582e-1f87-43a2-8da1-7e8251f7de9f None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:36.089194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693031-34ae-42ac-bd7b-219fcf3a8760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9b820082b0b41198dbb6712a90e71d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:36.090143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693031-34ae-42ac-bd7b-219fcf3a8760 admin admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:36.090443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693031-34ae-42ac-bd7b-219fcf3a8760 admin admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:36.090721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693031-34ae-42ac-bd7b-219fcf3a8760 admin admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:36.092139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693031-34ae-42ac-bd7b-219fcf3a8760 admin admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:36.093986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693031-34ae-42ac-bd7b-219fcf3a8760 admin admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:36.095641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu May 19 14:22:36 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:38.381936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93397548-ab8b-431f-bd3f-97cd1b628c90 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.382522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93397548-ab8b-431f-bd3f-97cd1b628c90 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.382522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93397548-ab8b-431f-bd3f-97cd1b628c90 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.384139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:38.392292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.392867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.393080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.397995 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581374b1-7281-4040-9816-32092b23b4fb None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.398319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581374b1-7281-4040-9816-32092b23b4fb None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.398611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581374b1-7281-4040-9816-32092b23b4fb None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.400014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:22:38.408208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.408675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.409133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.413513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:38.415184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:38.455462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG passlib.handlers.bcrypt [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=143653) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:22:38.455897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG passlib.handlers.bcrypt [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=143653) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:22:38.503016 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:38.504599 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:38.524866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:38.553593 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:38.580027 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:38.627368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:38.647843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:38.665949 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e37ef-bca5-4c1e-b2b9-e7826b67d128 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:38.698425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:38.699833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.700124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.700520 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.712251 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:38.724185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:38.725484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:22:38.726462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:22:38.731801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:38.752418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51fc1-0284-45b0-a0a6-1a75da0632f5 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:38.754846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:38.801735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:38.802751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.803127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.803414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.828957 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:38.848977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c51b9-1413-44cd-afe1-755964017aca None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:38.876220 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:38.878019 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:38.884327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:38.885005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:38.885291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:38.885937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:38.886339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:38.886711 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:38.888263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:38.900223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:38.905647 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:38.977112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:22:38.984801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:38.987570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:39.010112 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7a9ba-309f-480e-b18a-ed8b5b57fbf8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:39.044292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:39.045163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:39.045450 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:39.045735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:39.046977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:39.048459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:39.050086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:38 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:39.055371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:39.070717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:39.087876 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695176f-b4db-4cf6-88a5-5cabc7417159 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:39.123080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:39.123880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:39.124161 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:39.124438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:39.143351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:39.144819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:39.159848 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3de3-1d3d-4e56-94ea-34cdf3e4d4ff None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:22:39.165614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:39.166705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:39.167923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:22:39.167923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:22:39.167923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:22:39.167923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:22:39.167923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:22:39.172930 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:39.196225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:39.197028 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:39.197312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:39.197589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:39.199423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:39.200910 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:39.202523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:39.208172 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:39.249495 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:39.294112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4eb5-2bb0-43a4-b0e0-dfb73794b52c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:39.295715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:39.316068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5e449-c4c7-4296-bcf2-cc2fa7a0a2f1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:39.330987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:39.331663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:39.331950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:39.332233 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:39.332976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:39.333290 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:39.334697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063802fa-0cfa-42fa-a953-eb0eca77db3b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:39.352661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 10/20] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:39.352946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:39.353613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:39.353901 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:39.354183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:39.355736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.domain.id=default, user.id=28e00ecbc961470b94e1ba0cf14cceba) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:39.355958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:39.357457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212d116-3bd9-4f8d-ad49-59a265710d78 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:39.365073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 11/21] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:22:39 2022] GET /identity/v3/role_assignments?user.id=28e00ecbc961470b94e1ba0cf14cceba&scope.domain.id=default&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:42.037437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f762c-6297-42ae-b948-b82af43e1dd8 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.038555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f762c-6297-42ae-b948-b82af43e1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.039100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f762c-6297-42ae-b948-b82af43e1dd8 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.040686 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 11/22] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:42.048779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfaf1-a7ff-4f8d-b691-c895a77161e3 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.049279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfaf1-a7ff-4f8d-b691-c895a77161e3 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.049603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfaf1-a7ff-4f8d-b691-c895a77161e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.085518 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-83bdfaf1-a7ff-4f8d-b691-c895a77161e3 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:42.087185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-83bdfaf1-a7ff-4f8d-b691-c895a77161e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:42.214066 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 12/23] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:42.253052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f762c-6297-42ae-b948-b82af43e1dd8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:42.471426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b79c-6cb6-4259-b629-18ccc01f9c4b None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.472378 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b79c-6cb6-4259-b629-18ccc01f9c4b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.473086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b79c-6cb6-4259-b629-18ccc01f9c4b None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.483397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:42.489471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c755-ce5c-4052-bcf7-45d266fe5a0b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.490237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c755-ce5c-4052-bcf7-45d266fe5a0b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.490964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c755-ce5c-4052-bcf7-45d266fe5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.532215 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-55f7c755-ce5c-4052-bcf7-45d266fe5a0b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:42.533435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-55f7c755-ce5c-4052-bcf7-45d266fe5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:42.574502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f762c-6297-42ae-b948-b82af43e1dd8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:42.608472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:42.650696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:42.651543 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.652456 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.652735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.676266 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:42.677364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:42.684844 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 14/25] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:42.686217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85df0-36a1-44ca-85c6-2c4f2054719a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.686608 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85df0-36a1-44ca-85c6-2c4f2054719a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.686904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85df0-36a1-44ca-85c6-2c4f2054719a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.688352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 15/26] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:42.696005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.696316 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:22:42.696581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:42.698119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:42.700238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:22:42.700238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:22:42.700238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:22:42.700238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:22:42.700605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.700719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 12/27] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:42.709016 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:42.723706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:42.731383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:42.732634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:42.863301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 16/28] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:42.863977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:42.879596 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159f10-3708-4efc-8111-9b439f5c2cc6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:42.926287 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:42.927458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.927756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.928044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.929213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:42.929816 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:42.931511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c85e-080a-43c4-9b7e-255c7bbbc4b1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:42.948312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 13/29] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:42.950066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383a9e-ffe5-4355-98e2-6708c1104b68 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:42.950363 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383a9e-ffe5-4355-98e2-6708c1104b68 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:42.950654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383a9e-ffe5-4355-98e2-6708c1104b68 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:42.952460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 14/30] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:42.952989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383a9e-ffe5-4355-98e2-6708c1104b68 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:42.996110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:42.996982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bb02-f04a-46ea-bec1-efe26096fc82 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:43.037095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302dd43-e758-4f8f-9579-a89235fd6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:43.040058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302dd43-e758-4f8f-9579-a89235fd6f06 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.040399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302dd43-e758-4f8f-9579-a89235fd6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.040893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302dd43-e758-4f8f-9579-a89235fd6f06 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.041851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302dd43-e758-4f8f-9579-a89235fd6f06 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:43.046527 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302dd43-e758-4f8f-9579-a89235fd6f06 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:43.051233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:43.098105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383a9e-ffe5-4355-98e2-6708c1104b68 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:43.139259 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:43.140385 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.140823 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.141265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.154193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:43.163465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:43.164574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:43.165554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:22:43.168303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 15/31] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:43.169223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:43.186749 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 17/32] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:22:42 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:22:43.188729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.189306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.189924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.210489 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:43.212532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:43.269733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:43.284351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5fa7-3ad6-469c-a4e1-94650fbf1e66 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:43.302992 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 18/33] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:43.304379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:43.326046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:43.326046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.326046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.326046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.326556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:43.326653 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:43.470031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73971555-679c-4ae8-aa5a-9c16840fe6dd None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:43.518816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:43.550344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:43.550991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.551287 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.551578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.552362 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:43.552682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:43.554324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:43.573512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 19/34] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:43.576517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:43.602650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 16/35] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:22:43 2022] POST /identity/v3/projects => generated 301 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:22:43.604125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:43.764638 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd447d-68f8-4c6a-beac-6bcef3e66a98 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:43.808871 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:43.810975 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.811557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.812222 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.814451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:43.817107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:43.819971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 17/36] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:43 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:43.838118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:43.866863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4747f2d-add6-40a0-b788-397ea1a84697 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:43.868371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:43.945544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47169-bafd-44ed-bcb3-981452cc885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:43.946426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47169-bafd-44ed-bcb3-981452cc885d None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.946725 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47169-bafd-44ed-bcb3-981452cc885d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.947051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47169-bafd-44ed-bcb3-981452cc885d None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.947868 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b47169-bafd-44ed-bcb3-981452cc885d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:43.950643 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b47169-bafd-44ed-bcb3-981452cc885d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:43.977062 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 20/37] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:22:43 2022] POST /identity/v3/roles => generated 219 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:22:43.979407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bbd3e-992a-4ce7-8a9b-3eea6604faa9 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.979710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bbd3e-992a-4ce7-8a9b-3eea6604faa9 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.980070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bbd3e-992a-4ce7-8a9b-3eea6604faa9 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.981399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 21/38] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:43.988296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6af115-80eb-4af1-bc61-245ca5bc329c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:43.988693 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6af115-80eb-4af1-bc61-245ca5bc329c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:43.989108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6af115-80eb-4af1-bc61-245ca5bc329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:43.994744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e35e3-d65e-4811-aa0f-39a5e902c0e0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:44.014157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-fd6af115-80eb-4af1-bc61-245ca5bc329c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:44.015681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-fd6af115-80eb-4af1-bc61-245ca5bc329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:44.059978 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f177de-fd87-4533-ac36-b16c959621bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:44.060896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f177de-fd87-4533-ac36-b16c959621bd None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.061188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f177de-fd87-4533-ac36-b16c959621bd None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.061473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f177de-fd87-4533-ac36-b16c959621bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.070398 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f177de-fd87-4533-ac36-b16c959621bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:44.072107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f177de-fd87-4533-ac36-b16c959621bd None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:44.074400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:44.075017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 18/39] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:44.076385 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629f90-30ec-479d-a942-239077ad9c94 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.076678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629f90-30ec-479d-a942-239077ad9c94 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.076965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629f90-30ec-479d-a942-239077ad9c94 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.078538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 19/40] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:44.083488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629f90-30ec-479d-a942-239077ad9c94 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:44.111646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 22/41] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:44.119162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.119162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.119162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.143636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:44.144888 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:44.197789 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:44.227360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 23/42] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:44.227558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:44.234681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629f90-30ec-479d-a942-239077ad9c94 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:44.277926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:44.278844 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.279128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.279412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] PATH_INFO: `/v3/domains/default/users/28e00ecbc961470b94e1ba0cf14cceba/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.281440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=28e00ecbc961470b94e1ba0cf14cceba, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:44.282946 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:44.298590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 20/43] 10.222.0.71 () {58 vars in 1361 bytes} [Thu May 19 14:22:44 2022] PUT /identity/v3/domains/default/users/28e00ecbc961470b94e1ba0cf14cceba/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:22:44.299450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:44.358538 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832861a-0dc1-4ce9-825a-bd5f1939814c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:44.368755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:44.401553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:44.402596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.402982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.403267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.404548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:44.406060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:44.408057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 24/44] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:44.413771 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:44.416802 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028a61-968f-4c16-ad63-67055cc088d9 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:44.454884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3882c8-2df5-4392-9ae6-305b91f8a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:44.455573 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3882c8-2df5-4392-9ae6-305b91f8a6ed None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.455865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3882c8-2df5-4392-9ae6-305b91f8a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.456144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3882c8-2df5-4392-9ae6-305b91f8a6ed None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.456928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3882c8-2df5-4392-9ae6-305b91f8a6ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:44.458370 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3882c8-2df5-4392-9ae6-305b91f8a6ed None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:44.463118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:44.476209 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 21/45] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:22:44 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:22:44.536564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd0c9-1810-4516-9974-73900d5c6d48 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:44.577419 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fd00e-05bb-4a06-bdd0-ebc6d630459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:44.578117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd00e-05bb-4a06-bdd0-ebc6d630459e None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:44.578405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd00e-05bb-4a06-bdd0-ebc6d630459e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:44.578685 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd00e-05bb-4a06-bdd0-ebc6d630459e None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:44.579454 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fd00e-05bb-4a06-bdd0-ebc6d630459e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:44.580946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fd00e-05bb-4a06-bdd0-ebc6d630459e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:44.612162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 25/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:22:44 2022] POST /identity/v3/projects => generated 312 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:22:46.655325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e91ab-7171-4590-8419-db1e4b0db380 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:46.656024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e91ab-7171-4590-8419-db1e4b0db380 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:46.656024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e91ab-7171-4590-8419-db1e4b0db380 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:46.657286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 22/47] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:46.662544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:46.663007 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:46.663158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:46.683627 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:46.684846 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:46.707520 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:46.766425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 26/48] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:46.793944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e91ab-7171-4590-8419-db1e4b0db380 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:46.908104 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e91ab-7171-4590-8419-db1e4b0db380 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:46.941676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788b6f-83c8-491e-83a6-f4c3bc070ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:46.942475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788b6f-83c8-491e-83a6-f4c3bc070ace None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:46.942764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788b6f-83c8-491e-83a6-f4c3bc070ace None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:46.943074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788b6f-83c8-491e-83a6-f4c3bc070ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:46.953416 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788b6f-83c8-491e-83a6-f4c3bc070ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3c788b6f-83c8-491e-83a6-f4c3bc070ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:46.961082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:46.962519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:22:46.963478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 23/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:46.968272 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:47.011896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b18d0c-17fc-41b0-9a34-feccaf1b5713 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.012197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b18d0c-17fc-41b0-9a34-feccaf1b5713 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.012484 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b18d0c-17fc-41b0-9a34-feccaf1b5713 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.014490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 24/50] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:22:47.019657 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.019954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.020234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.037355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:47.038889 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:47.070374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370c9ce-bc2f-44d2-b72d-98825caf9914 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:47.090492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:47.105211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:47.105888 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.106222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.106440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.107250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:47.107564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:47.108118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 25/51] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:47.108974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:47.117203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 27/52] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:47.123306 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:47.132109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:47.151466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:47.224342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd086d7-43ac-4f29-b9ca-e0525bcd25a2 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:47.231739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493dc27-be08-4094-a15f-8a917e0d96bb None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:47.259162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:47.260044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.260332 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.260616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.262377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:47.263874 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:47.265527 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:47 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:47.270930 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:47.285996 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:47.286855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.287149 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.287430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.288691 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:47.290210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:47.292127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 28/54] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:47.298249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:47.333220 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:47.377263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfed54-b0e7-4777-8d79-3c09314ca167 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:47.388046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:47.403598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b59be-fe98-4736-a720-9a34b2692a98 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:47.411136 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:47.411932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.412224 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.412507 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.413719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:47.415201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:47.416834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:47.422738 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:47.437681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87350b-37e8-45ed-9386-f48a051abe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:47.438355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87350b-37e8-45ed-9386-f48a051abe48 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.438648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87350b-37e8-45ed-9386-f48a051abe48 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.438973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87350b-37e8-45ed-9386-f48a051abe48 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.439697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87350b-37e8-45ed-9386-f48a051abe48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:47.441262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87350b-37e8-45ed-9386-f48a051abe48 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:47.467584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 29/56] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:22:47 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:22:47.529580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b641d-7b95-4ea3-9d45-86d76cb19530 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:47.556159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:47.570730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:47.571485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:47.571774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:47.572062 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:47.572923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.domain.id=default, user.id=28e00ecbc961470b94e1ba0cf14cceba) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:47.573243 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:47.574906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3326-83f8-488e-b5ea-1fb14b44b908 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:47.584068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:22:47 2022] GET /identity/v3/role_assignments?user.id=28e00ecbc961470b94e1ba0cf14cceba&scope.domain.id=default&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:49.706556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be91fb1-431e-4989-b6ab-f2dee6bc7315 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:49.707129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be91fb1-431e-4989-b6ab-f2dee6bc7315 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:49.707229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be91fb1-431e-4989-b6ab-f2dee6bc7315 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:49.708535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 30/58] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:49.713672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:49.714674 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:49.714780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:49.732005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:49.733202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:49.799159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:49.823413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be91fb1-431e-4989-b6ab-f2dee6bc7315 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:49.924675 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be91fb1-431e-4989-b6ab-f2dee6bc7315 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:49.957203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0399-2aae-4de1-aafa-4729fde08507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:49.957933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0399-2aae-4de1-aafa-4729fde08507 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:49.958220 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0399-2aae-4de1-aafa-4729fde08507 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:49.958500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0399-2aae-4de1-aafa-4729fde08507 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:49.959716 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0399-2aae-4de1-aafa-4729fde08507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:49.961187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0399-2aae-4de1-aafa-4729fde08507 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:49.962807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 31/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:49.969188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:50.067618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfca0-3d27-473f-9864-681be2493fac None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:50.083442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:50.100837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e8c0-736a-4ae1-832d-3acf71b5d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:50.101511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e8c0-736a-4ae1-832d-3acf71b5d0ad None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:50.101802 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e8c0-736a-4ae1-832d-3acf71b5d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:50.102087 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e8c0-736a-4ae1-832d-3acf71b5d0ad None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:50.102815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e8c0-736a-4ae1-832d-3acf71b5d0ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:50.104276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e8c0-736a-4ae1-832d-3acf71b5d0ad None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:50.130809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 30/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:22:49 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:22:53.433771 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669a3c-bed2-485b-9ed8-e79d3c07f716 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:53.434697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669a3c-bed2-485b-9ed8-e79d3c07f716 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:53.435171 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669a3c-bed2-485b-9ed8-e79d3c07f716 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:53.436756 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 32/62] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:53.442296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193448c-4fa1-4db8-af85-6de20498c95f None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:53.443130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193448c-4fa1-4db8-af85-6de20498c95f None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:53.443580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193448c-4fa1-4db8-af85-6de20498c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:53.467887 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-2193448c-4fa1-4db8-af85-6de20498c95f None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:53.469393 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-2193448c-4fa1-4db8-af85-6de20498c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:53.558477 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 31/63] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:53.595001 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669a3c-bed2-485b-9ed8-e79d3c07f716 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:53.605188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:53.640629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be6dc-8d6e-4c0f-8fb6-d2190279fa62 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:53.640931 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be6dc-8d6e-4c0f-8fb6-d2190279fa62 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:53.641223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be6dc-8d6e-4c0f-8fb6-d2190279fa62 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:53.642639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 32/64] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:22:53.668267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:53.668585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:53.668841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:53.703996 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:53.705159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:53.730278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669a3c-bed2-485b-9ed8-e79d3c07f716 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:53.780436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:53.781582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:53.782050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:53.782497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:53.794113 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:53.803056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:53.804358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:22:53.805497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:22:53.807893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 33/65] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:53.815258 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:53.833649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 33/66] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:53.878893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:53.907232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:53.945268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29983-474d-412d-847e-6182162b6452 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:53.945989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.036602 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.037143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.037636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.038093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.039511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:54.040013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.042549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc1e41-5d4a-4ae4-907a-46e14d268b41 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.055117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 34/67] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:54.061469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9832bed-fcbb-4d2f-9531-248127312fff None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.061469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9832bed-fcbb-4d2f-9531-248127312fff None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.061469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9832bed-fcbb-4d2f-9531-248127312fff None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.061469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 35/68] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:54.063466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a47c4-8745-488d-a3c4-df32acae3f90 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.063754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a47c4-8745-488d-a3c4-df32acae3f90 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.064034 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a47c4-8745-488d-a3c4-df32acae3f90 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 36/69] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:22:54.067055 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a47c4-8745-488d-a3c4-df32acae3f90 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.075882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b244-bd60-4898-94dc-a421f6ccb888 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.115385 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bc2c1-cc7c-438a-a717-dfdc5995b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.116623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bc2c1-cc7c-438a-a717-dfdc5995b344 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.116814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bc2c1-cc7c-438a-a717-dfdc5995b344 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.117293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bc2c1-cc7c-438a-a717-dfdc5995b344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.128437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bc2c1-cc7c-438a-a717-dfdc5995b344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-446bc2c1-cc7c-438a-a717-dfdc5995b344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:54.136319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:54.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:22:54.138250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 34/70] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:54.143721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb277-bb20-475c-9eca-2a71b6bb5563 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.144021 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb277-bb20-475c-9eca-2a71b6bb5563 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.144307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb277-bb20-475c-9eca-2a71b6bb5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.163560 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-966fb277-bb20-475c-9eca-2a71b6bb5563 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:54.164632 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-966fb277-bb20-475c-9eca-2a71b6bb5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:54.180481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a47c4-8745-488d-a3c4-df32acae3f90 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.207570 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.215895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.216770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.217056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.217340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.231541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.233022 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.234184 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 35/71] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:54.234891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 37/72] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:54.235345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134107b-3977-4f75-9f16-ac317df3b925 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.235643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134107b-3977-4f75-9f16-ac317df3b925 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.235755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.236007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134107b-3977-4f75-9f16-ac317df3b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.259784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-0134107b-3977-4f75-9f16-ac317df3b925 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:54.261687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-0134107b-3977-4f75-9f16-ac317df3b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:54.278073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.328640 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 36/73] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:54.330334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e59dd8-33b7-4b43-b564-328ada4df88b None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.330814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e59dd8-33b7-4b43-b564-328ada4df88b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.331110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e59dd8-33b7-4b43-b564-328ada4df88b None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.332405 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 37/74] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:54.333107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e59dd8-33b7-4b43-b564-328ada4df88b None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.343183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e2f7d-96a4-4320-9051-a27c179fb6c8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.383307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.383983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.384274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.385310 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:54.385652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.387178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.395370 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 38/75] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:54.397581 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.447019 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.448628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e59dd8-33b7-4b43-b564-328ada4df88b None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.484960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.485623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.485916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.486204 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.500157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8b73-291e-4278-a9ca-cc303fd1a0c4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.507896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.533384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d290254-f35a-4753-acce-1359d99c8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.534197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d290254-f35a-4753-acce-1359d99c8e7d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.534491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d290254-f35a-4753-acce-1359d99c8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.534780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d290254-f35a-4753-acce-1359d99c8e7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.545462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d290254-f35a-4753-acce-1359d99c8e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-6d290254-f35a-4753-acce-1359d99c8e7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:54.553664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:54.554965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:22:54.556035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:22:54.556885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.556985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 39/76] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:54.556985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.556985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.557217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.558672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.574578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:54.575844 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:54.644174 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 40/77] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:54.645385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.676612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 38/78] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:22:54.677480 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.690691 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.730236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.751886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f948-6926-4b87-8a41-28ab569b7ebb None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.778561 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32847318-b2b8-4b27-b6e5-18bdcabdbc52 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.785945 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.786744 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.787068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.787354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.797592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:54.805424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:54.806623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 41/79] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:54.808138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.814812 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.815706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.815993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.816275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.817480 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.818973 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.820617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 39/80] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:54.821379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.911758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.915912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf050a8-e90c-43b9-bc00-2636bcf9dc6b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.924356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377091f-a4c7-4ba0-ad6a-afdeb386cfbb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:54.944447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:54.950136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.951031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.951329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.951616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.952378 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:54.952703 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.954135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.958325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:54.959159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:54.959451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:54.959737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:54.960942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:54.962050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 42/81] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:54.962384 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:54.962882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:54.965415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 40/82] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:54.966258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.065400 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9760-5bd8-49a6-9bde-1cd071a04fec None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.068599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ce73-a557-491a-89fa-86df3961c38b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.100278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.100958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.101244 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.101527 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.102079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.102288 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] RBAC: Adding query filter params (name=member) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:55.102606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.102987 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.103282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.103567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.104037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.105410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.106936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.108694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 43/83] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:55.109502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.116168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 41/84] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:55.119708 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.141684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.171585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.214859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f6ba-b84e-4337-8125-a00bbbc95a0d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.222050 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36f1d-384b-4aea-87ac-384a834a1826 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.248857 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.249504 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.249794 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.250076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.256341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.257222 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.257514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.257800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.259058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.260546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.262209 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 42/85] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:55.262984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.317276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.318759 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.344895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.368195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcf4c0-4ccb-4b00-b558-1561bcdd1e66 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.385769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.404005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.404684 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.404978 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.405297 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.406019 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.407510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.417373 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 44/86] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:22:55.418209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.446976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 43/87] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:22:55 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:22:55.446976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.537870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ed17e-5eab-48fb-9101-b34245da9b78 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.568783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4ff1e-a520-4edb-b629-8e1c1e2b31a6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.570157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.580207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.580875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.581162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.581443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.582302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=4427c679f7c645b989ffdfcc836ce81e) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:55.582620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.584177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.598838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 45/88] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/role_assignments?user.id=4427c679f7c645b989ffdfcc836ce81e&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:55.598838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.624613 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.625568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.626127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.626587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.628915 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.630445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.632822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 44/89] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:55.633942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.692510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.743379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296acb8-9776-48df-b566-323123a1bce8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.788458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f38fc8-ece8-4eaa-8cf4-0317b160e1b3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.790934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.792535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.793036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.793497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.834965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:55.835842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:55.836327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:55.836828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:55.838352 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.840419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.842577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 45/90] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:55.843534 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:55.871690 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:55.886965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:55.889448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:55.978341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8de9-7b55-466d-93f2-67e8bd7b3e42 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:55.989806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:56.021838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:56.022831 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:56.023372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:56.023976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:56.028595 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 46/91] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:22:56.029768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:56.107919 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:56.109760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:56.130582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:56.140410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a99fe-536f-435f-b276-21fac4014932 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:56.178555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:56.179257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:56.179550 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:56.179840 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:56.180802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=28e00ecbc961470b94e1ba0cf14cceba) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:56.181129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:56.183291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:56.189676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 47/92] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:22:56 2022] GET /identity/v3/role_assignments?user.id=28e00ecbc961470b94e1ba0cf14cceba&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:56.190308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:56.225909 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 46/93] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:22:56.233542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:56.254189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:56.349550 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabddbc-5f6e-49a2-8cc8-51219b9d5d25 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:56.411199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:56.412090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:56.412385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:56.412673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:56.413950 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:56.415689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:56.418477 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 48/94] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:22:56 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:56.424092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:56.460475 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:56.498138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af8d02-31ad-462b-b15e-6d4af2824a16 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:56.541097 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889ffa-ba3a-4606-b6fb-27a3007dc3a2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:56.581110 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:56.582071 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:56.582518 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:56.582995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:56.584235 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] RBAC: Adding query filter params (role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=4427c679f7c645b989ffdfcc836ce81e) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:56.584723 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:56.586349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:56.591511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fb849-c3cc-4dc6-a411-62f898ce4ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:56.592947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fb849-c3cc-4dc6-a411-62f898ce4ff9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:56.593416 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fb849-c3cc-4dc6-a411-62f898ce4ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:56.593738 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 49/95] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:22:56 2022] GET /identity/v3/role_assignments?user.id=4427c679f7c645b989ffdfcc836ce81e&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:56.593876 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fb849-c3cc-4dc6-a411-62f898ce4ff9 None admin] PATH_INFO: `/v3/projects/a2857c33452348749fb2c5ba5fa29ddf` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:56.603967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fb849-c3cc-4dc6-a411-62f898ce4ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=a2857c33452348749fb2c5ba5fa29ddf)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:56.605976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fb849-c3cc-4dc6-a411-62f898ce4ff9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:56.607922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 47/96] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:22:56 2022] GET /identity/v3/projects/a2857c33452348749fb2c5ba5fa29ddf => generated 312 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:56.613937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:56.767271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:56.778680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719f07-84e5-448e-8f02-ea0d8cdaaec5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:56.827834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:56.828523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:56.828821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:56.829116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:56.829980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=a2857c33452348749fb2c5ba5fa29ddf, user.id=4427c679f7c645b989ffdfcc836ce81e) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:56.830309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:56.831819 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6e53-5334-4210-9972-19d47a42085d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:56.837918 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 50/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:22:56 2022] GET /identity/v3/role_assignments?user.id=4427c679f7c645b989ffdfcc836ce81e&scope.project.id=a2857c33452348749fb2c5ba5fa29ddf&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:58.505591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1b3e-d005-4531-b9c9-943525ad356c None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:58.506689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1b3e-d005-4531-b9c9-943525ad356c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:58.507240 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1b3e-d005-4531-b9c9-943525ad356c None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:58.508857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 48/98] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:58.513912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:58.514418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186f27-9a3d-4052-861c-8f5c3119384b None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:58.514887 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186f27-9a3d-4052-861c-8f5c3119384b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:58.515098 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186f27-9a3d-4052-861c-8f5c3119384b None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:58.515368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:58.515863 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:58.516539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 51/99] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:58.535826 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:58.537065 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:58.537742 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:58.538249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:58.538752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:58.556378 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:58.558116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:58.638356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 49/100] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:22:58.668770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 52/101] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:58.689523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:58.692508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:58.715158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:58.875193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:58.907911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c75b3-8ee3-413b-94cd-d1eb8fa143d3 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:58.911330 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927a5f-c3ff-46f2-a6cd-9fd841f3351b None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:58.954312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:58.955150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:58.955444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:58.955730 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:58.958750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:58.960519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:58.962471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 53/102] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:58.969139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:58.969510 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:58.969977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:58.970270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:58.970557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:58.995697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:59.014277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:59.016618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:22:59.019454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 50/103] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:59.022660 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:59.160141 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2593c34-7c4c-4f1d-afbf-a1a4b5f5cc2b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:59.183306 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:59.218708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc53e8e-d8e7-48a4-b4ce-e1ed3e648021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:59.219419 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc53e8e-d8e7-48a4-b4ce-e1ed3e648021 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.219710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc53e8e-d8e7-48a4-b4ce-e1ed3e648021 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.219993 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc53e8e-d8e7-48a4-b4ce-e1ed3e648021 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.220736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc53e8e-d8e7-48a4-b4ce-e1ed3e648021 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:59.222240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc53e8e-d8e7-48a4-b4ce-e1ed3e648021 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:59.243867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510e39a-8d1c-4277-bb1f-2e5950f696c2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:59.261885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 54/104] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:22:58 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:22:59.263344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0445fb-444f-441c-9790-a19c258e6ecc None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.263648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0445fb-444f-441c-9790-a19c258e6ecc None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.263936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0445fb-444f-441c-9790-a19c258e6ecc None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.265390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 55/105] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:22:59.271103 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.271433 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.271677 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.282293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:59.304371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:22:59.306457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:22:59.328084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:59.328835 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.329133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.329419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.330196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:22:59.330514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:59.333725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:59.355217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 51/106] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:22:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:22:59.361367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:59.461124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 56/107] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:22:59.501923 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:59.556251 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5895-d7a1-4d7e-a463-ea6a11fa9f67 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:59.635814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:59.643997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:59.646017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.646308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.646596 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] PATH_INFO: `/v3/users/af941a41f2da44d49f384da7e6de3f47` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.681464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] RBAC: Authorizing `identity:get_user(user_id=af941a41f2da44d49f384da7e6de3f47)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:22:59.684591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:22:59.686383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 52/108] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:22:59 2022] GET /identity/v3/users/af941a41f2da44d49f384da7e6de3f47 => generated 289 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:22:59.691941 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:59.721994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771e003-cad8-43c8-a6b5-aeb2dea233ce None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:59.779534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:22:59.790296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:59.791127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.791952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.792330 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.813058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:22:59.824722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:22:59.825770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:22:59.826679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 57/109] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:22:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:22:59.831614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:22:59.889392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca0376-0e02-4831-aa4e-702264a53d13 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:22:59.964994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d08feb-de20-426e-b448-07bf9f492a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:22:59.965692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d08feb-de20-426e-b448-07bf9f492a54 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:22:59.965989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d08feb-de20-426e-b448-07bf9f492a54 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:22:59.966278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d08feb-de20-426e-b448-07bf9f492a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:22:59.994254 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f873a0-e689-445a-b8ad-e62d6163daa2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.068063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.069152 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.069681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.070174 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.071158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.071410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:00.071943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.074532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95b9a2-9509-45c6-b990-6ca4ce20c211 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.084435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 58/110] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:22:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:00.086090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9ac5-5a4a-4218-9d0a-f77388334862 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.086617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9ac5-5a4a-4218-9d0a-f77388334862 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.087315 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9ac5-5a4a-4218-9d0a-f77388334862 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.088883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 59/111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:00.090011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e9ac5-5a4a-4218-9d0a-f77388334862 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.099658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d08feb-de20-426e-b448-07bf9f492a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.103216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d08feb-de20-426e-b448-07bf9f492a54 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.193940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.252408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 53/112] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:00.258379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.258746 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.259002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.268482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e9ac5-5a4a-4218-9d0a-f77388334862 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.277917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:00.279513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:00.320893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255a9e-ead6-461d-8e5b-4f1f347b9e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.322176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255a9e-ead6-461d-8e5b-4f1f347b9e96 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.323314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255a9e-ead6-461d-8e5b-4f1f347b9e96 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.323865 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255a9e-ead6-461d-8e5b-4f1f347b9e96 None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.325886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255a9e-ead6-461d-8e5b-4f1f347b9e96 None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.327938 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255a9e-ead6-461d-8e5b-4f1f347b9e96 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.329663 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 60/113] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:00.331013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a157-8454-4e5d-abae-603e49ef3216 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.331308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a157-8454-4e5d-abae-603e49ef3216 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.331593 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a157-8454-4e5d-abae-603e49ef3216 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.332845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 61/114] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:00.333559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14a157-8454-4e5d-abae-603e49ef3216 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.360877 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 54/115] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:00.366831 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.397297 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.468870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14a157-8454-4e5d-abae-603e49ef3216 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.493447 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.502588 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d30d-f6fa-4c95-9f97-47d2cfa7bcac None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.507772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a32262-d452-49a8-a77e-3298d0b854e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.508659 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a32262-d452-49a8-a77e-3298d0b854e3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.508952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a32262-d452-49a8-a77e-3298d0b854e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.509237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a32262-d452-49a8-a77e-3298d0b854e3 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.510964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a32262-d452-49a8-a77e-3298d0b854e3 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.512473 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a32262-d452-49a8-a77e-3298d0b854e3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.515227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 62/116] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:00.520108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd163-4761-4ef4-b616-4ba1485d30c6 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.520399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd163-4761-4ef4-b616-4ba1485d30c6 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.520687 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd163-4761-4ef4-b616-4ba1485d30c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.538310 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-be8cd163-4761-4ef4-b616-4ba1485d30c6 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:00.539551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-be8cd163-4761-4ef4-b616-4ba1485d30c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:00.546497 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.547422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.547715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.548000 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.549219 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.550747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.557599 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 55/117] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:00.557599 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.618390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 63/118] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:00.631165 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d50d-cce3-47bd-8f2f-669234920d7d None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.631594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d50d-cce3-47bd-8f2f-669234920d7d None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.631988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d50d-cce3-47bd-8f2f-669234920d7d None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.633711 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 64/119] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:00 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:00.638409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d50d-cce3-47bd-8f2f-669234920d7d None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.652854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.670139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378914-6a5d-4bca-a562-b51a149c96d2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.707603 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.708663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.708955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.709234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.721146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:00.728846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:00.729890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:00.730848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:00.734943 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 56/120] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:00.735613 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.753498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d50d-cce3-47bd-8f2f-669234920d7d None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.787135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.803233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.803956 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.804366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.804653 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.805623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] RBAC: Adding query filter params (role.id=bc71484c5b9349a396d02d7c85bb5712, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=af941a41f2da44d49f384da7e6de3f47) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:00.805973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.808238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca72e94-5656-4154-975d-b29a83664801 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.823465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 65/121] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/role_assignments?user.id=af941a41f2da44d49f384da7e6de3f47&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=bc71484c5b9349a396d02d7c85bb5712 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:00.823465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.823465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.823465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.843117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:00.843117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:00.869325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82a4a-5a48-439c-aaad-15a387366e1d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:00.913719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:00.914813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:00.915220 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:00.915609 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/4427c679f7c645b989ffdfcc836ce81e/roles/984272f4fd594c06a9f31fcf059131e3` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:00.917941 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=31ce85495e994b6895e8ca60bd617b79, user_id=4427c679f7c645b989ffdfcc836ce81e, role_id=984272f4fd594c06a9f31fcf059131e3)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:00.919612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:00.940737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 57/122] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:00 2022] PUT /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/4427c679f7c645b989ffdfcc836ce81e/roles/984272f4fd594c06a9f31fcf059131e3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:00.941525 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:00.962309 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:00.964711 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 66/123] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:00.965620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.128284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4544-d668-4ff4-b502-093f5ff919b7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.159458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195180d-370a-4595-9476-d4746bb8f8dc None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.175184 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.176544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.176845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.177134 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.185671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:01.193336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:01.205250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:01.206333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:01.207321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 58/124] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:01.211403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.220394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.221402 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.221937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.222434 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.223452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:01.223988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:01.225643 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:01.234622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 67/125] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:01.235753 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.308330 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:01.340607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e4ad6-9188-4e45-976c-04a54e84ebb8 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.357033 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b19ac-a7e0-4044-8c05-720850dfd7fc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.396289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.397080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.397428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.397720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.398493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:01.399133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:01.400562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:01.410296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 68/126] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:01.411152 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.425143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.426320 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.426878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.427388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.438579 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:01.448311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:01.449432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:01.450689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:01.454780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 59/127] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:01.456366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.465635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:01.561291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9954c-212d-4b09-960d-a4243cfa7c5b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.602707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.604780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.605073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.605361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.606642 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:01.608503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:01.610898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 69/128] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:01.611816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.727101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb1724-8372-40f4-aeee-560675871538 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.734978 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:01.736885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c93fcf-312e-4b90-95f5-9e67db7dc673 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.765754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.766437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.767102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.767390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.768297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:01.768675 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:01.770197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:01.779343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 70/129] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:01.783819 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.828423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:01.863527 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.864440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.864733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.865020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.871549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:01.873043 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:01.874741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 60/130] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:01.876441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.905452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59ed1-ac33-43ef-bf73-ef77ec9f5783 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:01.946287 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:01.947304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:01.947641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:01.947936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:01.949286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:01.950856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:01.953226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 71/131] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:01.954301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:01.995551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:02.078215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229dcc-4301-4a57-92f2-4c0e4fcc38bc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.109931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a4eb-3cf6-4b22-b58a-812bfef5deb2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.124454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.125350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.125906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.126189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.127440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.128907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.130751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 61/132] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:02.131388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:02.146048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.146964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.147260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.147545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] PATH_INFO: `/v3/projects/a2857c33452348749fb2c5ba5fa29ddf` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.148784 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a2857c33452348749fb2c5ba5fa29ddf)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.150266 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.152920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 72/133] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:01 2022] GET /identity/v3/projects/a2857c33452348749fb2c5ba5fa29ddf => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:02.153780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:02.208553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:02.243759 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3f03f-f3ed-4c18-9eff-5b9956fa2e84 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.278614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da705-bbb2-4414-9615-aca02f3fe9b6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.279572 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.281087 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.281360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:02.282102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.282559 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/28e00ecbc961470b94e1ba0cf14cceba/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.285294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] RBAC: Authorizing `identity:create_grant(project_id=31ce85495e994b6895e8ca60bd617b79, user_id=28e00ecbc961470b94e1ba0cf14cceba, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.287065 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.303097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 62/134] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:02 2022] PUT /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/28e00ecbc961470b94e1ba0cf14cceba/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:02.304546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:02.331385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f229d-a672-4441-8079-57f2bf62c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.332293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f229d-a672-4441-8079-57f2bf62c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.332582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f229d-a672-4441-8079-57f2bf62c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.333493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f229d-a672-4441-8079-57f2bf62c3e5 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.343862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f229d-a672-4441-8079-57f2bf62c3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.345404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f229d-a672-4441-8079-57f2bf62c3e5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.347685 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 73/135] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:02 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:02.349151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74c8d-8b15-4d5f-9454-89f250f94e3c None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.349453 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74c8d-8b15-4d5f-9454-89f250f94e3c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.349753 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74c8d-8b15-4d5f-9454-89f250f94e3c None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.359496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 74/136] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:02.364078 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74c8d-8b15-4d5f-9454-89f250f94e3c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:02.437888 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af42a-caf5-440f-8a8c-d9952ce7ac9c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.466364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:02.478569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6f59b-03da-457f-a3a8-408ce57a0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.480465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f59b-03da-457f-a3a8-408ce57a0413 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.481002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f59b-03da-457f-a3a8-408ce57a0413 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.481959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f59b-03da-457f-a3a8-408ce57a0413 None admin] PATH_INFO: `/v3/projects/a2857c33452348749fb2c5ba5fa29ddf/users/4427c679f7c645b989ffdfcc836ce81e/roles/984272f4fd594c06a9f31fcf059131e3` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.484335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6f59b-03da-457f-a3a8-408ce57a0413 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2857c33452348749fb2c5ba5fa29ddf, user_id=4427c679f7c645b989ffdfcc836ce81e, role_id=984272f4fd594c06a9f31fcf059131e3)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.486395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6f59b-03da-457f-a3a8-408ce57a0413 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.515845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 63/137] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:02 2022] PUT /identity/v3/projects/a2857c33452348749fb2c5ba5fa29ddf/users/4427c679f7c645b989ffdfcc836ce81e/roles/984272f4fd594c06a9f31fcf059131e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:02.517531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.518196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.518827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.547976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:02.549554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:02.586421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74c8d-8b15-4d5f-9454-89f250f94e3c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.641909 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.643314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.644981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.645546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/4427c679f7c645b989ffdfcc836ce81e/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.649234 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=31ce85495e994b6895e8ca60bd617b79, user_id=4427c679f7c645b989ffdfcc836ce81e, role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.651281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.695364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 75/138] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:02 2022] PUT /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/4427c679f7c645b989ffdfcc836ce81e/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:02.724550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 64/139] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:02.770321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:02.814069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:02.932022 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6523c44-89a5-4a59-9590-b7568c57d6a9 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:02.983623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924ab15-853e-4d22-9e30-6f4e8f2e7a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:02.984453 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924ab15-853e-4d22-9e30-6f4e8f2e7a91 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:02.984741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924ab15-853e-4d22-9e30-6f4e8f2e7a91 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:02.985027 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924ab15-853e-4d22-9e30-6f4e8f2e7a91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:02.986353 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924ab15-853e-4d22-9e30-6f4e8f2e7a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:02.987893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924ab15-853e-4d22-9e30-6f4e8f2e7a91 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:02.989869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 76/140] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:02.996120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:03.137345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47348d-69fd-4c04-ac4a-8bc280f37787 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:03.161046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:03.185766 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553e47-5d4c-41fd-a12f-8235d152666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:03.186468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553e47-5d4c-41fd-a12f-8235d152666a None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:03.186763 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553e47-5d4c-41fd-a12f-8235d152666a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:03.187072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553e47-5d4c-41fd-a12f-8235d152666a None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:03.187805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553e47-5d4c-41fd-a12f-8235d152666a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:03.189266 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553e47-5d4c-41fd-a12f-8235d152666a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:03.237373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 65/141] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:02 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:03.825630 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ea150-c736-44ba-9f1f-95d065ab7246 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:03.826170 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ea150-c736-44ba-9f1f-95d065ab7246 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:03.826170 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ea150-c736-44ba-9f1f-95d065ab7246 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:03.827596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 77/142] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:03.833178 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfa52-c47b-435e-b7e9-2540da4d99a4 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:03.833484 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfa52-c47b-435e-b7e9-2540da4d99a4 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:03.833777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfa52-c47b-435e-b7e9-2540da4d99a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:03.868858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-ed0bfa52-c47b-435e-b7e9-2540da4d99a4 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:03.870642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ed0bfa52-c47b-435e-b7e9-2540da4d99a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:03.976740 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 66/143] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:04.013037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ea150-c736-44ba-9f1f-95d065ab7246 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:04.099796 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746601-1c4b-4c39-acd7-1a0b741b121d None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.100319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746601-1c4b-4c39-acd7-1a0b741b121d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.100319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746601-1c4b-4c39-acd7-1a0b741b121d None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.101938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 67/144] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:04.107564 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.107865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.108158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.146434 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:04.147681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:04.152672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:04.175471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ea150-c736-44ba-9f1f-95d065ab7246 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:04.225046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:04.226416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.229423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.230149 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.254040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:04.261662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 68/145] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:04.263509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:04.264573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:04.265572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:04.268305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 78/146] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:04.274101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:04.309797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:04.339442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:04.439336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8108cf-d127-4de4-b90d-af32ed4db707 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:04.511353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:04.512474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.512996 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.513483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.514596 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:04.515193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:04.516915 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:04.522359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb009244-cdae-44c5-af9a-e046835fb973 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:04.538424 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 69/147] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:04.545186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:04.567551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:04.568359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.568649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.568929 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.589205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:04.599340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:04.600413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:04.601336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:04.602049 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 79/148] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:04.611665 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:04.643457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:04.705044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:04.723227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11b0e-cdf7-46f3-a4dd-ddecb54cecdb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:04.778779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc5dd-b02c-41dd-ba7c-1e9d2e2cd6db None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:04.800466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:04.801377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.801668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.801952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] PATH_INFO: `/v3/users/af941a41f2da44d49f384da7e6de3f47` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.803244 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] RBAC: Authorizing `identity:get_user(user_id=af941a41f2da44d49f384da7e6de3f47)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:04.804956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:04.806583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 70/149] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/users/af941a41f2da44d49f384da7e6de3f47 => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:04.825922 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:04.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:04.827877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:04.828476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:04.829473 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:04.830003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:04.831671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:04.846833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:04.849757 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 80/150] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:04.860177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:05.006340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:05.043936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edac5f-1173-482d-9bba-8616805c29d6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:05.090948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb816-3366-4c7c-a527-20b075cb052f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:05.106232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:05.107486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.107782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.108066 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.109342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:05.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:05.113184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 81/151] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:05.119164 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:05.165152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:05.166579 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.166923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.167214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.171690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:05.173264 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:05.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 71/152] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:04 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:05.183791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:05.254252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:05.318143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eed4e-fa67-4332-8b18-c33754e0094e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:05.384594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:05.385296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.385591 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.385877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.406366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02b7c-8ad3-44af-b411-b2d24d2a4c26 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:05.424404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:05.464659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de843817-ca1e-498a-ac0b-ece20176a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:05.465989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de843817-ca1e-498a-ac0b-ece20176a150 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.466501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de843817-ca1e-498a-ac0b-ece20176a150 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.467177 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de843817-ca1e-498a-ac0b-ece20176a150 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/af941a41f2da44d49f384da7e6de3f47/roles/bc71484c5b9349a396d02d7c85bb5712` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.469770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de843817-ca1e-498a-ac0b-ece20176a150 None admin] RBAC: Authorizing `identity:create_grant(project_id=31ce85495e994b6895e8ca60bd617b79, user_id=af941a41f2da44d49f384da7e6de3f47, role_id=bc71484c5b9349a396d02d7c85bb5712)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:05.471490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de843817-ca1e-498a-ac0b-ece20176a150 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:05.512875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 72/153] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:05 2022] PUT /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79/users/af941a41f2da44d49f384da7e6de3f47/roles/bc71484c5b9349a396d02d7c85bb5712 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:05.522829 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:05.524765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:05.565907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b973e8-7973-422e-97e4-b5dba95b19ae None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.566629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b973e8-7973-422e-97e4-b5dba95b19ae None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.567278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b973e8-7973-422e-97e4-b5dba95b19ae None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.569252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 73/154] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:05.578698 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.579350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.579837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.613692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:05.614956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:05.693591 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 82/155] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:05.700428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:05.797185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 74/156] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:05.801243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:05.876176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:05.909327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2606f-3ca1-4179-869d-17ea96e0b9f4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:05.917465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:05.968275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:05.969639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:05.970138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:05.970637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:05.972377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:05.974107 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:05.976545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 83/157] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:05 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:05.982463 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:06.057428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076deda-68d4-4779-821b-e5cb2344c39c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:06.116221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:06.116973 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.117265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.117549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.142951 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:06.147056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814cf72-7b1d-4a12-85fb-fc6120ffd464 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:06.155107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:06.156172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:06.157100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 75/158] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:06.163353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:06.182146 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:06.211306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:06.212384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.212906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.213889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.214968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=4427c679f7c645b989ffdfcc836ce81e) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:06.215495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:06.217331 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:06.233717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 84/159] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:05 2022] GET /identity/v3/role_assignments?user.id=4427c679f7c645b989ffdfcc836ce81e&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:06.259821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:06.287421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def203-b703-4ef4-b761-aa76be4739b0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:06.338806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:06.339501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.339800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.340083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.340855 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:06.341171 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:06.342696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:06.357775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 76/160] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:06.363484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:06.503967 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7668a-b140-4dba-be47-914daed7a06f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:06.553052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58184900-1f6c-46b7-aab0-c4b19a4c2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:06.554369 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184900-1f6c-46b7-aab0-c4b19a4c2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.554899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184900-1f6c-46b7-aab0-c4b19a4c2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.555407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184900-1f6c-46b7-aab0-c4b19a4c2ea3 None admin] PATH_INFO: `/v3/users/28e00ecbc961470b94e1ba0cf14cceba` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.557037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184900-1f6c-46b7-aab0-c4b19a4c2ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=28e00ecbc961470b94e1ba0cf14cceba)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:06.558847 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184900-1f6c-46b7-aab0-c4b19a4c2ea3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:06.561148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 85/161] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:06 2022] GET /identity/v3/users/28e00ecbc961470b94e1ba0cf14cceba => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:06.566702 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:06.695430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e0228-9caf-4a0d-86c2-966a153320e0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:06.749218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:06.749892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.750183 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.750719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.773176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40434-714a-4f2f-8980-926b249614cb None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.773797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:06.774871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40434-714a-4f2f-8980-926b249614cb None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.775383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40434-714a-4f2f-8980-926b249614cb None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.777876 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 86/162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:06.786294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:06.786294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:06.786294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:06.815466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:06.816950 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:06.844723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:06.846610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:06.927300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:06.963911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 87/163] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:07.001921 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.011604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 77/164] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:07.018381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.070246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:07.156455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268507-d3be-4ad5-8dcd-3994ba9bd726 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:07.196368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a51f-7e63-4907-8dec-ed39f37366bf None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:07.205165 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:07.206954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.207480 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.207986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.209568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:07.211271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:07.219562 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 78/165] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:07.222331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:07.279835 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.280307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.280849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.301199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:07.309751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:07.310808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:07.311779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:07.314689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 88/166] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:07.320635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.368447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65151f88-4c3d-45bc-8096-3fea4ba6a977 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:07.377478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:07.393644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:07.419002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:07.420491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.420894 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.421286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.422422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=28e00ecbc961470b94e1ba0cf14cceba) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:07.423051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:07.424905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bfdd9-f16c-4b6c-a00a-399146465f19 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:07.437107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 79/167] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/role_assignments?user.id=28e00ecbc961470b94e1ba0cf14cceba&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:07.438676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8c6e-384d-4623-8a68-54ccfec7695e None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.439107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8c6e-384d-4623-8a68-54ccfec7695e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.439493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8c6e-384d-4623-8a68-54ccfec7695e None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.441244 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 80/168] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:07.447776 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.448215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.448602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.484069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:07.485333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:07.529437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31352fe-f12e-4bc6-98de-15ab40741bec None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:07.609288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:07.610225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.610664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.611226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.612153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:07.612633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:07.614245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:07.634229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 89/169] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:07.640289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.673758 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 81/170] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:07.734934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.825936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c061-938c-4b4a-bd0f-568dca65aeb7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:07.831668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:07.888613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:07.889818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:07.890310 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:07.890801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:07.892245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:07.897258 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:07.899296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 90/171] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:07.904923 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:07.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:07.963084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f7fd-7243-489d-9563-94ef06877d3d None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:08.018037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:08.018806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.019099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.019379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.035910 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:08.048938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:08.049983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:08.054350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 82/172] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:08.058469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a214-e195-415e-81db-daa044695bfe None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:08.059738 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:08.122416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212195d-ddc1-469f-9044-a8c3ca6ae842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:08.123487 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212195d-ddc1-469f-9044-a8c3ca6ae842 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.124000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212195d-ddc1-469f-9044-a8c3ca6ae842 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.124536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212195d-ddc1-469f-9044-a8c3ca6ae842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.185919 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:08.255205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212195d-ddc1-469f-9044-a8c3ca6ae842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:08.256695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212195d-ddc1-469f-9044-a8c3ca6ae842 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:08.289560 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82cdd4-ab32-4fad-ab3f-cd0363261b98 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:08.360247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:08.360933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.361213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.361492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.362277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:08.362567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:08.363982 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:08.374334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 83/173] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:08.379723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:08.415610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:08.462348 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 91/174] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:23:08.464273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f21d-c7a6-4b63-b211-90eb2f7aa77b None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.464567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f21d-c7a6-4b63-b211-90eb2f7aa77b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.464849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f21d-c7a6-4b63-b211-90eb2f7aa77b None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.466423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 92/175] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:08.472066 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.472369 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.472658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.509338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:08.511722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:08.549159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7a10-295f-4838-b54d-94b37c5599de None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:08.592414 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:08.594391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 93/176] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:08.595787 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:08.636152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:08.639504 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.640055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.641126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] PATH_INFO: `/v3/users/4427c679f7c645b989ffdfcc836ce81e` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.644831 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] RBAC: Authorizing `identity:get_user(user_id=4427c679f7c645b989ffdfcc836ce81e)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:08.647230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:08.649142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 84/177] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:08 2022] GET /identity/v3/users/4427c679f7c645b989ffdfcc836ce81e => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:08.651103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:08.776923 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aca11-77b3-4a3e-842c-4a32e9ece72c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:08.794846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:08.804229 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704793cf-363e-4057-8b0e-c085286eda52 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:08.852446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:08.853279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.854192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.854471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.865690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:08.867637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:08.868779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:08.869858 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:08.870367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] PATH_INFO: `/v3/projects/a2857c33452348749fb2c5ba5fa29ddf` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:08.871836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2857c33452348749fb2c5ba5fa29ddf)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:08.873653 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:08.874196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:08.875491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 85/178] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:08.877772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:08.880322 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 94/179] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:08 2022] GET /identity/v3/projects/a2857c33452348749fb2c5ba5fa29ddf => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:08.886392 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.008726 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.045612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d230-1d92-447d-99c2-2eddd14f1de1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.060987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16dac-57f0-4dc6-bb85-fbc8a8a998cc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.083072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.084029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.084393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.084773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.085676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:09.085987 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:09.087509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:09.097243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 95/180] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:09.098263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.100834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b084b1-2b34-4e46-86a1-0be5fb512922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.101741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b084b1-2b34-4e46-86a1-0be5fb512922 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.102299 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b084b1-2b34-4e46-86a1-0be5fb512922 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.102846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b084b1-2b34-4e46-86a1-0be5fb512922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.124723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.181271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b084b1-2b34-4e46-86a1-0be5fb512922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:09.183405 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b084b1-2b34-4e46-86a1-0be5fb512922 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:09.212147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacfc0b-80b2-4e99-ac97-1d9a68697719 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.245816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.252622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.253286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.253577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.253872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.254708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=a2857c33452348749fb2c5ba5fa29ddf, user.id=4427c679f7c645b989ffdfcc836ce81e) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:09.255077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:09.256801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89252421-7418-47dc-bab0-23a96465a530 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:09.263808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 96/181] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/role_assignments?user.id=4427c679f7c645b989ffdfcc836ce81e&scope.project.id=a2857c33452348749fb2c5ba5fa29ddf&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:09.265046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabdfe-5f97-4833-b2d8-a23cec1500a5 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.265342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabdfe-5f97-4833-b2d8-a23cec1500a5 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.265625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabdfe-5f97-4833-b2d8-a23cec1500a5 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.267066 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 97/182] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:09.272710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabdfe-5f97-4833-b2d8-a23cec1500a5 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.308186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 86/183] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:09.310770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e80c-127a-40ad-bb78-10703c9ba74b None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.311361 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e80c-127a-40ad-bb78-10703c9ba74b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.311815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749e80c-127a-40ad-bb78-10703c9ba74b None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.313992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 87/184] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:09.315660 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.316182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.316736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.340299 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:09.342604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:09.405754 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.407173 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabdfe-5f97-4833-b2d8-a23cec1500a5 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.430302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 88/185] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:09.431024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.452576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5342b80-6040-4c34-bd8d-d9a1e609fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.454398 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5342b80-6040-4c34-bd8d-d9a1e609fc89 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.454695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5342b80-6040-4c34-bd8d-d9a1e609fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.455015 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5342b80-6040-4c34-bd8d-d9a1e609fc89 None admin] PATH_INFO: `/v3/users/2b55bd9ee62949bda52c5445e646e907` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.473657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5342b80-6040-4c34-bd8d-d9a1e609fc89 None admin] RBAC: Authorizing `identity:get_user(user_id=2b55bd9ee62949bda52c5445e646e907)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:09.475198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5342b80-6040-4c34-bd8d-d9a1e609fc89 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:09.477570 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 98/186] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/users/2b55bd9ee62949bda52c5445e646e907 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:09.478364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4faefc-dfb0-4a4a-80dd-69a48d7bd5d8 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.478662 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4faefc-dfb0-4a4a-80dd-69a48d7bd5d8 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.478984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4faefc-dfb0-4a4a-80dd-69a48d7bd5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.498017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-fe4faefc-dfb0-4a4a-80dd-69a48d7bd5d8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:09.499297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-fe4faefc-dfb0-4a4a-80dd-69a48d7bd5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:09.549925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f088-2a59-47dc-8933-50a30d25817b None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.562213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.582872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 99/187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:09.584283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358a07b-d74b-4f1a-8476-894f8c57be48 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.584582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358a07b-d74b-4f1a-8476-894f8c57be48 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.584862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358a07b-d74b-4f1a-8476-894f8c57be48 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.586150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 100/188] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:09.586882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358a07b-d74b-4f1a-8476-894f8c57be48 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.592505 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.593381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.593667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.593944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.597291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:09.598758 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:09.600672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 89/189] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:09.601326 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.651580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.698200 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358a07b-d74b-4f1a-8476-894f8c57be48 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.704948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43007-3bc6-49b1-bc4c-1771b3a712d1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.732931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff4d52-d548-408f-9491-0b245a834d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.733825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff4d52-d548-408f-9491-0b245a834d45 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.734173 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff4d52-d548-408f-9491-0b245a834d45 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.734456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff4d52-d548-408f-9491-0b245a834d45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.739050 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.739753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.740083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.740361 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.745061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff4d52-d548-408f-9491-0b245a834d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d5ff4d52-d548-408f-9491-0b245a834d45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:09.753297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:09.754646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:09.755613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 101/190] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:09.756371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.756371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.756371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:09.773491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:09.774679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:09.809525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.812434 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:09.813857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:09.841256 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 102/191] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:09.842210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.869491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:09.928464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 90/192] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:09.929322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:09.963338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45a1d6-df5b-4fe4-8b5b-5f0b4020ddb8 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:09.998625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:09.999314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:09.999603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:09.999893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.000994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] RBAC: Adding query filter params (role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=4427c679f7c645b989ffdfcc836ce81e) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:10.001313 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.002772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.008750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 103/193] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/role_assignments?user.id=4427c679f7c645b989ffdfcc836ce81e&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.010231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.034342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e348-64f1-4e17-b8d8-acd4d85952b2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.050712 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.077335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.078073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.078356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.078636 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.079945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.081433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.083162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 91/194] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.083948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.105721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.137048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d8011-a6f2-4e96-911b-bef42a3f9c40 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.177345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.178103 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.178397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.178686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.179507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:10.179827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.181556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.192475 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 104/195] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.193445 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.208890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbab2-1010-409d-b7fb-b76a71d08b46 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.247848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.248662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.248948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.249232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.261786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:10.269744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:10.270972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 92/196] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:10.271993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.309607 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.313320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4275bc-e247-410f-8f81-5fc35d29ad01 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.348152 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.348955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.349246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.349532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.350735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.352231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.354146 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 105/197] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.354555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.354771 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.378941 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aabc90-7fa1-4840-ae93-3b31d204c4b7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.412590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.413263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.413540 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.413817 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.414542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.416018 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.435677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 93/198] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:10 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:10.436496 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.471925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0233-31fd-4da4-816c-221feaae84a2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.512664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.513783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.514092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.514469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] PATH_INFO: `/v3/users/2b55bd9ee62949bda52c5445e646e907` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.515818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b55bd9ee62949bda52c5445e646e907)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.517342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.519392 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 106/199] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/users/2b55bd9ee62949bda52c5445e646e907 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.520207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.557630 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbb5f1-9933-489e-95d3-471f0d2b8826 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.562934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.596546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.603361 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.604526 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.605316 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.605954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.606888 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] RBAC: Adding query filter params (name=reader) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:10.607369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.608790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.622261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 94/200] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.622261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.654384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84617-2447-4a15-a956-1c222b1feec5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.697277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.698521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.698521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.698754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.699511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=2b55bd9ee62949bda52c5445e646e907) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:10.699934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.701547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.709918 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 107/201] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/role_assignments?user.id=2b55bd9ee62949bda52c5445e646e907&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.711011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:10.754208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2913c3-3b67-45ff-8535-f366d6dd887c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.805661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.806996 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.807445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.807912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.855076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.862248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855fa66-6150-42a0-9278-b9c33cc58825 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:10.894223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:10.904784 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:10.905903 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:10.906295 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.906421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:10.906762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] PATH_INFO: `/v3/users/af941a41f2da44d49f384da7e6de3f47` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:10.907820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.908301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] RBAC: Authorizing `identity:get_user(user_id=af941a41f2da44d49f384da7e6de3f47)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:10.910031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:10.912432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 108/202] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/users/af941a41f2da44d49f384da7e6de3f47 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:10.924540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:11.044544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 95/203] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:11.050493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:11.077439 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657164d0-376f-4c79-a235-32137b228b0d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:11.123731 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:11.124315 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:11.124601 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:11.124880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:11.204166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:11.249900 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:11.260757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61cdc9-b7a3-4334-a2b7-e6113dabd187 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:11.294609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:11.296148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:11.307860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:11.308739 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:11.309025 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:11.309300 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:11.310541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:11.312041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:11.314195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 96/204] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:11 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:11.319793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:11.450396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f2048-9c02-46d3-a280-309588e2c6ae None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:11.488089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 109/205] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:23:11.490024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:11.490964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:11.491423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:11.491936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:11.493042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] RBAC: Adding query filter params (role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=2b55bd9ee62949bda52c5445e646e907) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:11.493512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:11.493959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:11.495389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:11.502039 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 97/206] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:11 2022] GET /identity/v3/role_assignments?user.id=2b55bd9ee62949bda52c5445e646e907&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:11.587188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:11.648566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f6f78-2fa1-4b9d-8a80-6e00ea4b6740 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:11.694183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cb54b-b86c-4664-a56b-c3d209f21d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:11.695171 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb54b-b86c-4664-a56b-c3d209f21d10 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:11.695459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb54b-b86c-4664-a56b-c3d209f21d10 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:11.695738 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb54b-b86c-4664-a56b-c3d209f21d10 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:11.697689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cb54b-b86c-4664-a56b-c3d209f21d10 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:11.699229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cb54b-b86c-4664-a56b-c3d209f21d10 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:11.701340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 110/207] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:11 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:11.707589 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:11.745520 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:11.836273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2e47-23e1-494c-990a-181510534227 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:11.879815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:11.880508 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:11.880790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:11.881070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:11.881940 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] RBAC: Adding query filter params (role.id=bc71484c5b9349a396d02d7c85bb5712, scope.project.id=31ce85495e994b6895e8ca60bd617b79, user.id=af941a41f2da44d49f384da7e6de3f47) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:11.882255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:11.883747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e514a-f96d-4ee8-9bc0-51e582c6893d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:11.890762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 98/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:11 2022] GET /identity/v3/role_assignments?user.id=af941a41f2da44d49f384da7e6de3f47&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=bc71484c5b9349a396d02d7c85bb5712 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:13.130959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fc75-ef04-428a-9850-9099f4b6dd63 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.132010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fc75-ef04-428a-9850-9099f4b6dd63 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.132542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fc75-ef04-428a-9850-9099f4b6dd63 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.134688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 111/209] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:13.140948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.141926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.142441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.160735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:13.162321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:13.214155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336056-f603-4c98-a22a-ab4e01ea319a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.214913 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336056-f603-4c98-a22a-ab4e01ea319a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.215406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336056-f603-4c98-a22a-ab4e01ea319a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.218370 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 112/210] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:13.222694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e83e94-e53b-4756-9edb-bd77d7c15583 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.223251 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e83e94-e53b-4756-9edb-bd77d7c15583 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.223822 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e83e94-e53b-4756-9edb-bd77d7c15583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.235927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 99/211] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:13.242941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a2e83e94-e53b-4756-9edb-bd77d7c15583 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:13.244192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a2e83e94-e53b-4756-9edb-bd77d7c15583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:13.260246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.283489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:13.317845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 113/212] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:13.319223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b022-4b9e-4394-a4a3-66d66dea0e24 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.319516 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b022-4b9e-4394-a4a3-66d66dea0e24 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.319797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b022-4b9e-4394-a4a3-66d66dea0e24 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.321524 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 114/213] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:13.328008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.328432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.328851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.346081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:13.347311 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:13.377511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5fed7-721a-4a4e-b607-ee1b8724ec6a None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.411257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:13.419862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 115/214] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:13.420004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.420796 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.421215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.421469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.421578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.436199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:13.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:13.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:13.446226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 100/215] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:13.451984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.532075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9534eda-7360-43bc-a3ac-bf5699003e5b None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.547176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:13.568228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54a1a-c12a-4cb0-81b7-c78fb7de5b7f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.569932 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.571576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.571921 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.572714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.573973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:13.575483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:13.577728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 116/216] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:13.578331 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.610673 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.611515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.611798 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.612081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.624172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:13.632598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:13.633659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:13.635221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 101/217] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:13.636959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.659081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:13.704131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4cb16-868c-4ecb-8812-76b53ff4f1ee None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.741125 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.741808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.742099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.742383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.743173 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:13.743485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:13.745533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:13.751106 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437d46-5975-4b58-aa49-2fbcff56e393 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.754824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 117/218] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:13.760681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.790348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.791181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.791469 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.791751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.792472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:13.793918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:13.804582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:13.816606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 102/219] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:13 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:13.817436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:13.911486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c9cb-7f64-42e1-ac55-8c9449d02fa3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.946845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:13.953415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2133dd-2a5d-409e-bdb9-796cfb6651c5 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:13.965235 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.966700 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:13.967674 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:13.968171 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:13.969443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:13.970517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:13.972534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:13.994393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 118/220] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:13.997303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:13.998485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.000151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.000766 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.001067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] PATH_INFO: `/v3/users/d105eb99ffd64748bd6f89b6f1cddfa9` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.021742 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] RBAC: Authorizing `identity:get_user(user_id=d105eb99ffd64748bd6f89b6f1cddfa9)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.023543 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:14.030869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 103/221] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/users/d105eb99ffd64748bd6f89b6f1cddfa9 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:14.033270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.113179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:14.151724 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec80d67-0da0-4405-b97c-d48e2ba58db7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.173092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67026f92-2c2d-43cc-9d65-a1dcfccaa70f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.195723 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dba2a-5ae1-4add-b0a6-9bd13b0dabc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.197113 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dba2a-5ae1-4add-b0a6-9bd13b0dabc5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.197408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dba2a-5ae1-4add-b0a6-9bd13b0dabc5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.197689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dba2a-5ae1-4add-b0a6-9bd13b0dabc5 None admin] PATH_INFO: `/v3/users/2b55bd9ee62949bda52c5445e646e907` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.199218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dba2a-5ae1-4add-b0a6-9bd13b0dabc5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b55bd9ee62949bda52c5445e646e907)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.201229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dba2a-5ae1-4add-b0a6-9bd13b0dabc5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:14.203136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 119/222] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:13 2022] GET /identity/v3/users/2b55bd9ee62949bda52c5445e646e907 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:14.204430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1daad-e101-409c-b79e-d95b05d0e76c None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.204723 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1daad-e101-409c-b79e-d95b05d0e76c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.205005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1daad-e101-409c-b79e-d95b05d0e76c None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.206531 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 120/223] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:14.208660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1daad-e101-409c-b79e-d95b05d0e76c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.214346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e591d-ba64-4669-91a2-a3ffeeafc73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.215046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e591d-ba64-4669-91a2-a3ffeeafc73a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.215391 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e591d-ba64-4669-91a2-a3ffeeafc73a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.215618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e591d-ba64-4669-91a2-a3ffeeafc73a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.289977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:14.292077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e591d-ba64-4669-91a2-a3ffeeafc73a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.293548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e591d-ba64-4669-91a2-a3ffeeafc73a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:14.358979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:14.364066 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1daad-e101-409c-b79e-d95b05d0e76c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.410995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.412283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.412413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 104/224] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:14.413046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.413529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.413827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.414194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.414545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.415835 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.418002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:14.421232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 121/225] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:14 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:14.422645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.433014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:14.434445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:14.510295 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 105/226] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:14.511314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.551798 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d07f78-6cc8-4ed5-8250-af2ef268f40c None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.581283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:14.598895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.599766 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.600052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.600397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.601697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.604101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:14.606235 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 122/227] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:14 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:14.607229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.633703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:14.656925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3701-2b84-4429-bb39-c72a6b327b0b None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.701227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.702528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.702838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.709270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/2b55bd9ee62949bda52c5445e646e907/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.714367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f32a0f6e0ae4f0aaeb4113f675da332, user_id=2b55bd9ee62949bda52c5445e646e907, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.715962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:14.728720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec44d47-39ba-4c37-a789-5b38e36a2cb8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.734877 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 106/228] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:14 2022] PUT /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/2b55bd9ee62949bda52c5445e646e907/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:14.735913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.779101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.780453 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.781018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.781519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.798993 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:14.808823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:14.810599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:14.812320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:14.815833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 123/229] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:14.824074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:14.912499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520af1d-3493-46c9-99ce-63f62efd0443 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:14.959204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:14.993212 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:14.993934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:14.994275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:14.994553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:14.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=d105eb99ffd64748bd6f89b6f1cddfa9) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:14.995848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:14.997283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:15.009489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 107/230] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:14 2022] GET /identity/v3/role_assignments?user.id=d105eb99ffd64748bd6f89b6f1cddfa9&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:15.032416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03759e-0e01-4915-935a-131bcfe7023a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:15.073305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:15.074438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:15.074984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:15.075503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:15.076506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:15.077051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:15.078750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:15.089127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 124/231] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:15.097723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:15.118583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:15.261859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd823-37b5-48d3-bd33-93c1048c498c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:15.298433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:15.299271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:15.299557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:15.299839 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] PATH_INFO: `/v3/users/2b55bd9ee62949bda52c5445e646e907` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:15.301073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=2b55bd9ee62949bda52c5445e646e907)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:15.302541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:15.304635 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 108/232] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:15 2022] GET /identity/v3/users/2b55bd9ee62949bda52c5445e646e907 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:15.311056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:15.433612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d26ed-3ac3-4974-8752-b6d72327eb93 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:15.448342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:15.471452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3190b-a859-4a38-92c2-631a0acc951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:15.472621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3190b-a859-4a38-92c2-631a0acc951b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:15.473095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3190b-a859-4a38-92c2-631a0acc951b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:15.473537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3190b-a859-4a38-92c2-631a0acc951b None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:15.474963 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3190b-a859-4a38-92c2-631a0acc951b None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:15.476979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3190b-a859-4a38-92c2-631a0acc951b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:15.485143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 125/233] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:15 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:15.492872 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:15.595936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:15.620187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9125ef-902b-4edf-8386-86b0809b0aa4 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:15.672399 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51634f7c-1e64-4dd4-a0e0-9983a9aff25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:15.673301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51634f7c-1e64-4dd4-a0e0-9983a9aff25c None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:15.673582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51634f7c-1e64-4dd4-a0e0-9983a9aff25c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:15.673856 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51634f7c-1e64-4dd4-a0e0-9983a9aff25c None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/2b55bd9ee62949bda52c5445e646e907/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:15.676158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51634f7c-1e64-4dd4-a0e0-9983a9aff25c None admin] RBAC: Authorizing `identity:create_grant(project_id=0f32a0f6e0ae4f0aaeb4113f675da332, user_id=2b55bd9ee62949bda52c5445e646e907, role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:15.677789 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51634f7c-1e64-4dd4-a0e0-9983a9aff25c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:15.705715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 109/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:15 2022] PUT /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/2b55bd9ee62949bda52c5445e646e907/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:16.718263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1846b02-6d47-4211-b696-90314858c601 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:16.718854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1846b02-6d47-4211-b696-90314858c601 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:16.718854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1846b02-6d47-4211-b696-90314858c601 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:16.720516 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 126/235] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:16.732940 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:16.733461 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:16.733552 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:16.751474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:16.752685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:16.788228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d489e-11b8-4861-8935-06cd51506cf5 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:16.788581 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d489e-11b8-4861-8935-06cd51506cf5 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:16.788794 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d489e-11b8-4861-8935-06cd51506cf5 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:16.791143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 127/236] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:16.795938 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:16.796225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:16.796508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:16.821031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:16.822345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:16.872997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 110/237] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:16.925980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:16.971468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 128/238] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:17.017991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:17.027314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:17.101651 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f328207-7c00-4a1c-86f7-89c89a640e0f None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:17.169753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:17.171009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.171528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.173298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.174747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:17.176582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:17.179555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 111/239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:17.188555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:17.216611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1125-d02c-4809-8d4e-626d179d1022 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:17.237450 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:17.293189 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:17.294501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.295048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.295555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.315359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:17.327153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:17.328261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:17.329187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:17.340500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 129/240] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:17.346012 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:17.421477 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76dd18-02b2-4c1a-a2dc-cf83e0ae2b08 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:17.523652 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:17.524763 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.525357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.525860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.526816 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:17.528591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:17.537233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613f96-c440-48d0-ac1b-5e7e42f319e3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:17.542442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:17.579977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:17.581232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.581760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.582274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.583294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:17.583830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:17.585474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99beef-0d44-4853-bc68-32bc46691f48 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:17.597888 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 112/241] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:17 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:17.606765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 130/242] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:17.612166 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:17.678630 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a392d7-51b7-4a33-941e-4ef24f5034b2 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.679389 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a392d7-51b7-4a33-941e-4ef24f5034b2 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.679924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a392d7-51b7-4a33-941e-4ef24f5034b2 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.681982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 131/243] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:17.692669 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.693327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.693830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.725621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:17.726916 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:17.791883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:17.818961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf824-ae46-4d73-9a7e-947e2d45fa4a None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:17.914318 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 132/244] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:17.925572 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e6bf0-5a73-4329-977b-a7ab91b7bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:17.926423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e6bf0-5a73-4329-977b-a7ab91b7bd0c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.930809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e6bf0-5a73-4329-977b-a7ab91b7bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.930809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e6bf0-5a73-4329-977b-a7ab91b7bd0c None admin] PATH_INFO: `/v3/users/3913837f718d4cc8a61549006da35765` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.934472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:17.974813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e6bf0-5a73-4329-977b-a7ab91b7bd0c None admin] RBAC: Authorizing `identity:get_user(user_id=3913837f718d4cc8a61549006da35765)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:17.982036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e6bf0-5a73-4329-977b-a7ab91b7bd0c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:17.982036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 113/245] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:17 2022] GET /identity/v3/users/3913837f718d4cc8a61549006da35765 => generated 297 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:17.988415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c35a-9ae5-4981-a82b-49f7a1b48479 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:17.988415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c35a-9ae5-4981-a82b-49f7a1b48479 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:17.988991 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c35a-9ae5-4981-a82b-49f7a1b48479 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:17.991548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 114/246] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:17.992146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c35a-9ae5-4981-a82b-49f7a1b48479 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.098905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.113627 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22c0f5-49a4-4f4c-96dc-4d672197d817 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.154734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f3ca-acf2-49bc-a86b-813e6f1b4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.155579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f3ca-acf2-49bc-a86b-813e6f1b4327 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.155863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f3ca-acf2-49bc-a86b-813e6f1b4327 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.156258 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f3ca-acf2-49bc-a86b-813e6f1b4327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.171423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681f3ca-acf2-49bc-a86b-813e6f1b4327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-0681f3ca-acf2-49bc-a86b-813e6f1b4327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:18.179197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:18.180218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:18.181210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:18.185389 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 133/247] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:18.187145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.187342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c35a-9ae5-4981-a82b-49f7a1b48479 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.187467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.187707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.205047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:18.206422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:18.227637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.229314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.229942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.230242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.230608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.287513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 134/248] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:18.288883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.305558 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:18.308964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:18.359920 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.420326 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 115/249] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:18.421198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.444805 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17da938-c1ac-45e2-a256-185429a73a62 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.518599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.519702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.520198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.520767 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.527294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:18.527454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168fcf4-e2f6-459f-adbc-c329b503ebf2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.528322 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:18.529975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:18.545404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 135/250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:18.546769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.562208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.566832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.566832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.566832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.583175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.587800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:18.599884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:18.601153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:18.602107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:18.603458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 116/251] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:18.606950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.632072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.701797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294cb14-f487-4ba5-93a3-d28f1d21535e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.726715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35914-dd1f-4072-b421-836b3d1151eb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.739262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.740877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.741323 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.741786 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.743197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:18.745523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:18.747842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 136/252] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:18.748837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.763291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e5af8-4127-4fb2-937e-c040dc53e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.764085 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5af8-4127-4fb2-937e-c040dc53e879 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.764381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5af8-4127-4fb2-937e-c040dc53e879 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.764656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5af8-4127-4fb2-937e-c040dc53e879 None admin] PATH_INFO: `/v3/users/2b55bd9ee62949bda52c5445e646e907` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.765930 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e5af8-4127-4fb2-937e-c040dc53e879 None admin] RBAC: Authorizing `identity:get_user(user_id=2b55bd9ee62949bda52c5445e646e907)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:18.767488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e5af8-4127-4fb2-937e-c040dc53e879 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:18.769590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 117/253] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/users/2b55bd9ee62949bda52c5445e646e907 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:18.770826 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110970-06e4-49b5-84e7-344face5b79c None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.771102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110970-06e4-49b5-84e7-344face5b79c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.771383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110970-06e4-49b5-84e7-344face5b79c None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.777351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 118/254] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:18.777351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110970-06e4-49b5-84e7-344face5b79c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.857774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.863420 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:18.885481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110970-06e4-49b5-84e7-344face5b79c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.886948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c91c8c-9a99-4c04-ba20-5c92e2063f89 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:18.922178 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.922892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.923182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.923464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.924310 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] RBAC: Adding query filter params (role.id=bc71484c5b9349a396d02d7c85bb5712, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=3913837f718d4cc8a61549006da35765) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:18.924627 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:18.925312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:18.926075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:18.926459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.927003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.927492 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.928547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:18.929244 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:18.931422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d590c99-873c-46fb-8967-cae76d9297f2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:18.933038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 119/255] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/role_assignments?user.id=3913837f718d4cc8a61549006da35765&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=bc71484c5b9349a396d02d7c85bb5712 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:18.933833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:18.941992 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 137/256] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:18.943919 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:18.944435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:18.944968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:18.965699 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:18.967500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:19.045291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 138/257] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:19.046551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.115942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e695-d5f6-4ed4-81a8-9c36c007fa7d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.156479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:19.168783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.169748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.170207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.170655 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.183223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:19.186151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cccb65-adae-4d3a-be2f-568e206b6190 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.225739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.226820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.227224 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.227608 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] PATH_INFO: `/v3/users/d105eb99ffd64748bd6f89b6f1cddfa9` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.229218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] RBAC: Authorizing `identity:get_user(user_id=d105eb99ffd64748bd6f89b6f1cddfa9)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:19.230995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:19.232842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 139/258] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/users/d105eb99ffd64748bd6f89b6f1cddfa9 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:19.233862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.251387 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:19.253286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:19.355105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771206-3329-44fe-bbcc-a5ab9186f53d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.372357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 120/259] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:19.373514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.394501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.395440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.395806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.396183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.409698 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:19.420061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:19.421147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 140/260] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:19.422105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.428151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:19.430994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:19.522689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d2a7-8149-456d-b58d-60d2fd54b8e2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.572136 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.573012 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.573294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.573569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.579534 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:19.581001 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:19.582730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 121/261] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:19.585391 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.629239 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628597a-debc-4bf4-b02e-778b5e215105 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.689478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.690334 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.690615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.690912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.692101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:19.693581 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:19.700165 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 141/262] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:19.700979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.782224 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:19.808999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7da25-f5be-48ec-8281-8fa6e015cb8f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.817518 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86fbaf-a945-4e1c-b5ac-5d1d21dec12f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:19.829238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:19.855375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.856534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.857004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.857454 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/d105eb99ffd64748bd6f89b6f1cddfa9/roles/984272f4fd594c06a9f31fcf059131e3` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.859640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f32a0f6e0ae4f0aaeb4113f675da332, user_id=d105eb99ffd64748bd6f89b6f1cddfa9, role_id=984272f4fd594c06a9f31fcf059131e3)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:19.861113 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:19.878847 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 142/263] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:19 2022] PUT /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/d105eb99ffd64748bd6f89b6f1cddfa9/roles/984272f4fd594c06a9f31fcf059131e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:19.881075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:19.889791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:19.890493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:19.890769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:19.891077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:19.891856 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:19.892162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:19.893581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:19.917634 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 122/264] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:19.923577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:20.094351 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45ff29-50ed-4efb-8db9-0e9e8cebc669 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:20.127789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:20.132247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5092f-25ff-48c5-aacf-bb6392ae4b33 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:20.138959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:20.138959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:20.138959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:20.138959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:20.139366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=2b55bd9ee62949bda52c5445e646e907) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:20.139366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:20.139366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:20.148367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 143/265] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/role_assignments?user.id=2b55bd9ee62949bda52c5445e646e907&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:20.211700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:20.213584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:20.214095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:20.214578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] PATH_INFO: `/v3/users/2b55bd9ee62949bda52c5445e646e907` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:20.216362 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] RBAC: Authorizing `identity:get_user(user_id=2b55bd9ee62949bda52c5445e646e907)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:20.218165 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:20.220334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 123/266] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:19 2022] GET /identity/v3/users/2b55bd9ee62949bda52c5445e646e907 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:20.226243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:20.370560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9a8e5-b0fe-4b4e-9ebe-c67c560690de None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:20.411774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:20.412442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:20.412729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:20.413011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:20.483187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:20.490180 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:20.491790 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:20.630712 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 144/267] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:20.637532 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:20.707841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:20.786852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710599-9e23-4b14-863c-66dfa74fc910 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:20.836423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa2fa0-1ca9-4436-a60b-295afa4d58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:20.837903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2fa0-1ca9-4436-a60b-295afa4d58f2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:20.838191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2fa0-1ca9-4436-a60b-295afa4d58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:20.838475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2fa0-1ca9-4436-a60b-295afa4d58f2 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:20.839729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa2fa0-1ca9-4436-a60b-295afa4d58f2 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:20.850916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa2fa0-1ca9-4436-a60b-295afa4d58f2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:20.851218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 124/268] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:20 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:20.857494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:20.937496 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39826543-9c3a-4990-943f-44470b5f3b26 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:20.938068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39826543-9c3a-4990-943f-44470b5f3b26 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:20.938068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39826543-9c3a-4990-943f-44470b5f3b26 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:20.939620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 125/269] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:20.944408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:20.944696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:20.944976 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:20.966241 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:20.968081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:20.968788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:20.977194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec367a0-1767-4b96-81ba-54ab853d9c46 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.020504 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.021226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.021510 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.021789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.022633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] RBAC: Adding query filter params (role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=2b55bd9ee62949bda52c5445e646e907) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:21.022971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:21.024862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05775f-d7cc-40bb-80bb-a086b0d51ad4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:21.032925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 145/270] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:20 2022] GET /identity/v3/role_assignments?user.id=2b55bd9ee62949bda52c5445e646e907&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:21.034575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4dfd-f141-4e69-b6e1-f7c179c713d7 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.034883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4dfd-f141-4e69-b6e1-f7c179c713d7 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.035166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4dfd-f141-4e69-b6e1-f7c179c713d7 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.036461 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 146/271] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:21.042779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.043139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.043366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.057667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 126/272] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:21.065057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:21.066679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:21.081990 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:21.131205 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:21.173533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 147/273] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:21.231226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f94c7-c815-4d34-b7d9-edec1a09de3a None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.239931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:21.276412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.277333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.277622 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.277899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.290924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:21.299080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:21.300141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:21.301135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 127/274] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:21.306845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:21.372495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:21.392011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e13f09-393c-432b-b3e7-7be61240945c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.433909 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.434769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.435128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.435410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.436724 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:21.438214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:21.440388 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 148/275] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:21.449326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:21.463740 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:21.474766 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa42c23-4087-4983-bafb-7881b684ebd3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.523048 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.524126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.524877 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.525771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.527048 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] RBAC: Adding query filter params (name=member) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:21.527572 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:21.530081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:21.541994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 128/276] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:21.549236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:21.581284 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d28d9-ef2e-404b-a15d-7a6144115c3c None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.631692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.633350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.634635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.635155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.636304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:21.638946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:21.677002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417065d-17d2-4187-8dc3-563747ccc215 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.686936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 149/277] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:21 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:21.729335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d1254-a3c0-4cf3-8336-d5f565771626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.730335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1254-a3c0-4cf3-8336-d5f565771626 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.730621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1254-a3c0-4cf3-8336-d5f565771626 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.730927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1254-a3c0-4cf3-8336-d5f565771626 None admin] PATH_INFO: `/v3/users/b226039c4d1f4f04ba7583c7d1b0d109` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.752213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1254-a3c0-4cf3-8336-d5f565771626 None admin] RBAC: Authorizing `identity:get_user(user_id=b226039c4d1f4f04ba7583c7d1b0d109)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:21.754320 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1254-a3c0-4cf3-8336-d5f565771626 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:21.756853 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 129/278] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:21 2022] GET /identity/v3/users/b226039c4d1f4f04ba7583c7d1b0d109 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:21.763695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:21.781270 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:21.871011 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5e850-93cc-4e2d-a07d-12bfe1c286a4 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.871690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5e850-93cc-4e2d-a07d-12bfe1c286a4 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.872193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5e850-93cc-4e2d-a07d-12bfe1c286a4 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.878409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 130/279] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:21.880502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.880798 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.881073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.885501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f545b-0a0b-45e0-a7d7-900401d1def7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:21.903941 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:21.905148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:21.918211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:21.928395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:21.930137 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:21.930658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:21.931776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:21.934167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, user.id=b226039c4d1f4f04ba7583c7d1b0d109, scope.system=all) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:21.934616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:21.936255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:21.941813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 150/280] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:23:21 2022] GET /identity/v3/role_assignments?user.id=b226039c4d1f4f04ba7583c7d1b0d109&scope.system=all&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:22.012352 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 131/281] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:22.034812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:22.134531 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:22.163481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72b96b-8414-49c0-846b-904d871198f4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:22.201444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:22.202255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:22.202588 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:22.202903 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:22.214361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:22.222273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:22.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:22.224416 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 151/282] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:22.229435 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:22.348632 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccf4c8-96fa-4376-aac4-970cde8c490d None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:22.385723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:22.386412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:22.386697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:22.387009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:22.387778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:22.388093 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:22.389487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:22.398721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 132/283] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:22.404068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:22.568914 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc347e2-c524-4b48-9326-7ab8cdc7c458 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:22.619606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:22.620420 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:22.620707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:22.620990 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] PATH_INFO: `/v3/users/3913837f718d4cc8a61549006da35765` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:22.622253 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] RBAC: Authorizing `identity:get_user(user_id=3913837f718d4cc8a61549006da35765)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:22.623766 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:22.625999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 152/284] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:22 2022] GET /identity/v3/users/3913837f718d4cc8a61549006da35765 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:22.631185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:22.643106 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:22.785611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136f510-5a5d-4fbe-ada9-9c49fd9a5d5f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:22.831665 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73306f0-f2ca-4012-93ef-3cada568adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:22.832629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73306f0-f2ca-4012-93ef-3cada568adf8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:22.832917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73306f0-f2ca-4012-93ef-3cada568adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:22.833195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73306f0-f2ca-4012-93ef-3cada568adf8 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:22.834404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73306f0-f2ca-4012-93ef-3cada568adf8 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:22.835877 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73306f0-f2ca-4012-93ef-3cada568adf8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:22.839014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 133/285] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:22 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:22.844130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:22.856296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:22.895880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74371c4e-c02f-4009-ae6c-b7d487cb697f None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:22.896197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74371c4e-c02f-4009-ae6c-b7d487cb697f None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:22.896378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74371c4e-c02f-4009-ae6c-b7d487cb697f None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:22.898018 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 134/286] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:22.902956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:22.903249 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:22.903530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:22.935997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:22.937207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:23.016360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d70c5-cbcb-42f6-8701-363951c1ee7f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:23.052465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:23.054727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:23.054727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:23.054727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/3913837f718d4cc8a61549006da35765/roles/bc71484c5b9349a396d02d7c85bb5712` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:23.056403 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f32a0f6e0ae4f0aaeb4113f675da332, user_id=3913837f718d4cc8a61549006da35765, role_id=bc71484c5b9349a396d02d7c85bb5712)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:23.058003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:23.078809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 135/287] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:23.090501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 153/288] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:23:22 2022] PUT /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/users/3913837f718d4cc8a61549006da35765/roles/bc71484c5b9349a396d02d7c85bb5712 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:23.109060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:23.127199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:23.250451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a39b53-99aa-4433-a0bd-5d2ea382d42a None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:23.312020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:23.312854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:23.313216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:23.313502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:23.329830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:23.338378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:23.339516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:23.340470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 136/289] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:23.347331 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:23.416930 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:23.459970 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af39b0-9e4e-406d-9a89-ca35bd619912 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:23.504555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:23.505167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:23.505458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:23.505743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:23.506523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:23.506860 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:23.508332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:23.521846 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 154/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:23.527939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:23.616351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:23.666725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90109461-e239-4a24-b56a-7f4b9b4929fe None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:23.712861 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:23.714151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:23.714666 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:23.715194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] PATH_INFO: `/v3/users/d105eb99ffd64748bd6f89b6f1cddfa9` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:23.716630 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] RBAC: Authorizing `identity:get_user(user_id=d105eb99ffd64748bd6f89b6f1cddfa9)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:23.718303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:23.720188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 137/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:23 2022] GET /identity/v3/users/d105eb99ffd64748bd6f89b6f1cddfa9 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:23.725728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:23.885349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd1a8c-e39d-461b-aff3-4fc5640652c8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:23.922105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:23.931783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:23.932642 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:23.932948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:23.933232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.024941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:24.026428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:24.152497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 155/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:24.158567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:24.287714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc14646-bf1c-4b7e-9314-4e3185525156 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:24.330392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d04f4f-1461-4f6b-858c-b0ef7222195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:24.331301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d04f4f-1461-4f6b-858c-b0ef7222195b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.331588 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d04f4f-1461-4f6b-858c-b0ef7222195b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.331866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d04f4f-1461-4f6b-858c-b0ef7222195b None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.333103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d04f4f-1461-4f6b-858c-b0ef7222195b None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:24.334569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d04f4f-1461-4f6b-858c-b0ef7222195b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:24.336350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 138/293] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:24 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:24.343078 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:24.401308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:24.521083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb101-2eac-41ab-aea4-47b079cffa10 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:24.572949 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:24.573664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.573951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.574233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.575107 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=d105eb99ffd64748bd6f89b6f1cddfa9) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:24.575430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:24.576899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c8703-54b4-4a37-b4a1-abae2c37a62a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:24.587843 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 156/294] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:24 2022] GET /identity/v3/role_assignments?user.id=d105eb99ffd64748bd6f89b6f1cddfa9&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:24.863056 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d7e9-79df-4d4d-927f-5cd5936d8e25 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.863422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d7e9-79df-4d4d-927f-5cd5936d8e25 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.863623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d7e9-79df-4d4d-927f-5cd5936d8e25 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.865043 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 139/295] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:24.870329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4820b3-307c-4965-8445-a869b39e5435 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.870329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4820b3-307c-4965-8445-a869b39e5435 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.870329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4820b3-307c-4965-8445-a869b39e5435 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.872216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.872660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 157/296] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:24.873197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.873694 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.881109 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:24.886135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897127-ec24-40dd-a2c8-baab2b72497b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.886417 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897127-ec24-40dd-a2c8-baab2b72497b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.886697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897127-ec24-40dd-a2c8-baab2b72497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.905490 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-0d897127-ec24-40dd-a2c8-baab2b72497b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:24.906586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-0d897127-ec24-40dd-a2c8-baab2b72497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:24.909792 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:24.911201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:24.985580 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 158/297] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:24.995398 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d7f4-7d77-44b4-86d5-dad1697a55b0 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:24.995783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d7f4-7d77-44b4-86d5-dad1697a55b0 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:24.996146 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d7f4-7d77-44b4-86d5-dad1697a55b0 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:24.997637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 159/298] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:25.003800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 140/299] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:25.004412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.004919 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.005408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.014506 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.026503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:25.028726 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:25.046053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.106957 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 160/300] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:25.108071 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.145473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b1522-c11c-4123-b65b-0478bb873f48 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.177098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.182950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.184395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.184686 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.185031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.186229 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.187725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.189537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 141/301] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:25.190140 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.232045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb4e2-0b6f-44d9-b48e-53a9df8b910b None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.268943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.270182 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.270536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.270842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.282648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:25.290533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:25.291664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 161/302] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:25.292637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.303774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5ba8-35c7-4f0a-beab-e90ef265c6a3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.306848 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.343252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.344197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.344346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.344621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.356506 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:25.364392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:25.365432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 142/303] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:25.366383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.408863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040bee-4004-4805-baa3-f162d028f368 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.429546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.448617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.449294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.449580 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.449856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] PATH_INFO: `/v3/groups` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.450669 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.452302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.478824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 162/304] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:23:25 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:25.478824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.486479 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366595-b7ee-4501-bbc7-a0f8696499bb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.537904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.538729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.539293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.539583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.541441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:25.541763 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.543250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.559127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 143/305] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:25.564068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.572896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.615298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa043b-d84c-4db2-900a-eb7b57e6d5d1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.660811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.661512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.662097 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.662990 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:25.663312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.664815 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.675774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 163/306] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:25.681796 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.722185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87553d19-8a2d-439f-a03d-938ad8c3a970 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.750855 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.768726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.770623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.770945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.771229 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] PATH_INFO: `/v3/users/ef308338260c4edc8b72c582626c7ccb` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.788450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] RBAC: Authorizing `identity:get_user(user_id=ef308338260c4edc8b72c582626c7ccb)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.790580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.792404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 144/307] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/users/ef308338260c4edc8b72c582626c7ccb => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:25.798062 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.810079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533c17c-119d-4dd0-8340-34479887642d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.843285 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:25.848278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dbeca-2719-47ae-b3a6-2f155097dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.849560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dbeca-2719-47ae-b3a6-2f155097dd7c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.850070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dbeca-2719-47ae-b3a6-2f155097dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.851328 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dbeca-2719-47ae-b3a6-2f155097dd7c None admin] PATH_INFO: `/v3/users/b226039c4d1f4f04ba7583c7d1b0d109` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.853432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dbeca-2719-47ae-b3a6-2f155097dd7c None admin] RBAC: Authorizing `identity:get_user(user_id=b226039c4d1f4f04ba7583c7d1b0d109)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.855408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dbeca-2719-47ae-b3a6-2f155097dd7c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.857665 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 164/308] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/users/b226039c4d1f4f04ba7583c7d1b0d109 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:25.864082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89252-0ff2-4841-89e9-883054a8e43f None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.864378 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89252-0ff2-4841-89e9-883054a8e43f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.864669 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89252-0ff2-4841-89e9-883054a8e43f None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.866053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 165/309] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:25.866696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89252-0ff2-4841-89e9-883054a8e43f None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:25.916499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa3c1-6ea7-4b9a-9968-95d155584033 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.953135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442e773-4621-4506-be5f-f7003662702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:25.953961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442e773-4621-4506-be5f-f7003662702a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.954152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442e773-4621-4506-be5f-f7003662702a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.954386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442e773-4621-4506-be5f-f7003662702a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.955276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442e773-4621-4506-be5f-f7003662702a None admin] RBAC: Adding query filter params (role.id=bc71484c5b9349a396d02d7c85bb5712, user.id=ef308338260c4edc8b72c582626c7ccb, scope.system=all) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:25.955588 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442e773-4621-4506-be5f-f7003662702a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:25.957017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442e773-4621-4506-be5f-f7003662702a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:25.963484 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 145/310] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:23:25 2022] GET /identity/v3/role_assignments?user.id=ef308338260c4edc8b72c582626c7ccb&scope.system=all&role.id=bc71484c5b9349a396d02d7c85bb5712 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:25.968250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:25.968554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:25.968815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:25.987730 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89252-0ff2-4841-89e9-883054a8e43f None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:25.987945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:25.989094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:26.037912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:26.045260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:26.047511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:26.048217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:26.048746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] PATH_INFO: `/v3/system/users/b226039c4d1f4f04ba7583c7d1b0d109/roles/984272f4fd594c06a9f31fcf059131e3` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:26.050977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b226039c4d1f4f04ba7583c7d1b0d109, role_id=984272f4fd594c06a9f31fcf059131e3)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:26.053264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:26.069746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 166/311] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:23:25 2022] PUT /identity/v3/system/users/b226039c4d1f4f04ba7583c7d1b0d109/roles/984272f4fd594c06a9f31fcf059131e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:26.087766 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 146/312] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:26.106072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:26.184468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:26.231336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58d7c-728c-4bc3-8fc5-50cc98faa780 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:26.272499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:26.273304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:26.273592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:26.273869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:26.285004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:26.292927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:26.293988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:26.294995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 167/313] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:26.300862 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:26.411039 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4012e3c-79c8-4ffd-86ca-af5b1f41ac04 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:26.447814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:26.448417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:26.448700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:26.448979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:26.449744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:26.450053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:26.451461 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:26.461089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 147/314] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:26.467149 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:26.575555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c343-6909-41c4-a6bc-0a049147725d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:26.599511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:26.612077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:26.612958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:26.613242 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:26.613521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] PATH_INFO: `/v3/users/3913837f718d4cc8a61549006da35765` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:26.614735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] RBAC: Authorizing `identity:get_user(user_id=3913837f718d4cc8a61549006da35765)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:26.616247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:26.618754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 168/315] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:26 2022] GET /identity/v3/users/3913837f718d4cc8a61549006da35765 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:26.624268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:26.662599 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:26.731622 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fae71-8ae0-41d7-a243-a34aa8f92131 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:26.769614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:26.770282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:26.770566 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:26.770872 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:26.850256 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:26.851795 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:26.889286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:26.967056 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 148/316] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:26.968604 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:27.070030 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d07ce-a7f7-4ad3-9d83-558f7974aae2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:27.103428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03906ca-f4c5-4af9-890e-e2c187e83c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:27.104292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03906ca-f4c5-4af9-890e-e2c187e83c10 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:27.104577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03906ca-f4c5-4af9-890e-e2c187e83c10 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:27.104855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03906ca-f4c5-4af9-890e-e2c187e83c10 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:27.106046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03906ca-f4c5-4af9-890e-e2c187e83c10 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:27.107538 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03906ca-f4c5-4af9-890e-e2c187e83c10 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:27.113626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 169/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:26 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:27.115562 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:27.220748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd01a2-4706-414f-b52f-e27f1d51100b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:27.257060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:27.257724 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:27.258007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:27.258283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:27.259324 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] RBAC: Adding query filter params (role.id=bc71484c5b9349a396d02d7c85bb5712, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332, user.id=3913837f718d4cc8a61549006da35765) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:27.259637 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:27.261061 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3d1b5-9a60-441e-bc2f-178f32493ed2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:27.270901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 149/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:27 2022] GET /identity/v3/role_assignments?user.id=3913837f718d4cc8a61549006da35765&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=bc71484c5b9349a396d02d7c85bb5712 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:27.271494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:27.894757 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead76b2-9781-40f9-b774-110e80d92e4a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:27.895152 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead76b2-9781-40f9-b774-110e80d92e4a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:27.895357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead76b2-9781-40f9-b774-110e80d92e4a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:27.896925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 170/319] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:27.902047 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:27.902508 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:27.902606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:27.919711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:27.920911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:27.993835 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 150/320] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:28.017161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead76b2-9781-40f9-b774-110e80d92e4a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.080728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:28.129634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead76b2-9781-40f9-b774-110e80d92e4a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.163124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cd546-cba2-4408-9b93-83289ec772e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:28.163927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd546-cba2-4408-9b93-83289ec772e6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.164215 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd546-cba2-4408-9b93-83289ec772e6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.164492 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd546-cba2-4408-9b93-83289ec772e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.166224 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cd546-cba2-4408-9b93-83289ec772e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:28.167736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cd546-cba2-4408-9b93-83289ec772e6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:28.169624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 171/321] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:28.175102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.268562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f462ac-2a5e-4f8e-bc50-1240384f09fd None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.268858 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f462ac-2a5e-4f8e-bc50-1240384f09fd None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.269140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f462ac-2a5e-4f8e-bc50-1240384f09fd None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.270525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 172/322] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:28.276412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3791422-5363-4fea-9d47-be27167fd93f None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.276703 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3791422-5363-4fea-9d47-be27167fd93f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.276985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3791422-5363-4fea-9d47-be27167fd93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.277377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e618-c5dd-4f82-adde-7ad814d3d998 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.295395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a3791422-5363-4fea-9d47-be27167fd93f None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:28.296651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a3791422-5363-4fea-9d47-be27167fd93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:28.312223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:28.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:28.320869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.321186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.321469 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] PATH_INFO: `/v3/groups` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.322177 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:28.323662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:28.350819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 151/323] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:23:28 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:28.386093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 173/324] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:28.407450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.488738 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b27d-367c-4eb5-832a-a3b6860f179a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.489073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b27d-367c-4eb5-832a-a3b6860f179a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.489321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b27d-367c-4eb5-832a-a3b6860f179a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.490946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 174/325] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:28.497109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.497477 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.497663 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.515860 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:28.517083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:28.531534 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b40da-7fc1-42ae-84d2-cd701d5d48e3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.574127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:28.575794 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.576254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.576703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.581260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:28.590765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:28.596901 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 175/326] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:28.598737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:28.599925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:28.601058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 152/327] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:28.606154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.621404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.683066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:28.731651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9543f-afa8-4e26-a383-277ff96b8a0c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.754580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9798b4a-8f4d-4126-8508-8aa85b6fda6d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.778521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:28.779562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.779851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.780129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.780896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:28.781207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:28.782632 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:28.792234 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 176/328] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:28.798389 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.805044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:28.806697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.807033 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.807286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.821124 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:28.829615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:28.830731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:28.831711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 153/329] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:28.840591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.871101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:28.934599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a8f95-dff0-4b4b-88c0-67b3c7f47299 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.974898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:28.975787 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:28.976073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:28.976354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] PATH_INFO: `/v3/users/ef308338260c4edc8b72c582626c7ccb` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:28.977713 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] RBAC: Authorizing `identity:get_user(user_id=ef308338260c4edc8b72c582626c7ccb)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:28.979369 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:28.981321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 177/330] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:28 2022] GET /identity/v3/users/ef308338260c4edc8b72c582626c7ccb => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:28.982175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0e7e-f097-41b8-802c-0c432a0244f1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:28.987178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:28.996763 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:29.033438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:29.034569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:29.035168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:29.035673 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:29.036658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] RBAC: Adding query filter params (name=member) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:29.037801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:29.040679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:29.052574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 154/331] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:29.059760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:29.108862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea80b0a-5c6b-49a0-9880-10b1de0ca037 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:29.128454 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:29.151352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:29.152223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:29.152507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:29.152789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] PATH_INFO: `/v3/system/users/ef308338260c4edc8b72c582626c7ccb/roles/bc71484c5b9349a396d02d7c85bb5712` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:29.154645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef308338260c4edc8b72c582626c7ccb, role_id=bc71484c5b9349a396d02d7c85bb5712)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:29.156130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:29.172533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 178/332] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:23:28 2022] PUT /identity/v3/system/users/ef308338260c4edc8b72c582626c7ccb/roles/bc71484c5b9349a396d02d7c85bb5712 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:29.197537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827feb6b-5457-495d-93fe-3e1e64d6bd24 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:29.248110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027017c3-c0b2-487a-adf7-88ec3d4a2b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:29.249081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027017c3-c0b2-487a-adf7-88ec3d4a2b58 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:29.249688 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027017c3-c0b2-487a-adf7-88ec3d4a2b58 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:29.249979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027017c3-c0b2-487a-adf7-88ec3d4a2b58 None admin] PATH_INFO: `/v3/users/b226039c4d1f4f04ba7583c7d1b0d109` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:29.252360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027017c3-c0b2-487a-adf7-88ec3d4a2b58 None admin] RBAC: Authorizing `identity:get_user(user_id=b226039c4d1f4f04ba7583c7d1b0d109)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:29.254009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027017c3-c0b2-487a-adf7-88ec3d4a2b58 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:29.256142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 155/333] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:29 2022] GET /identity/v3/users/b226039c4d1f4f04ba7583c7d1b0d109 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:29.263095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:29.404692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf16b-04f6-4c4b-a514-291df829fac3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:29.443449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:29.444533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:29.445073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:29.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:29.447411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] RBAC: Adding query filter params (role.id=984272f4fd594c06a9f31fcf059131e3, user.id=b226039c4d1f4f04ba7583c7d1b0d109, scope.system=all) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:29.448014 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:29.449708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ea344-d72c-4cff-a91a-c5086f81e31d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:29.464465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 179/334] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:23:29 2022] GET /identity/v3/role_assignments?user.id=b226039c4d1f4f04ba7583c7d1b0d109&scope.system=all&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:31.423731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9a131-5f01-4f33-8bf3-69aff0c375a1 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:31.424301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9a131-5f01-4f33-8bf3-69aff0c375a1 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:31.424301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9a131-5f01-4f33-8bf3-69aff0c375a1 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:31.426149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 156/335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:31.431820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14114d-7813-4e9c-a94f-2d08874c06e7 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:31.432298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14114d-7813-4e9c-a94f-2d08874c06e7 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:31.432388 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14114d-7813-4e9c-a94f-2d08874c06e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:31.454970 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-1c14114d-7813-4e9c-a94f-2d08874c06e7 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:31.456196 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-1c14114d-7813-4e9c-a94f-2d08874c06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:31.504180 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:31.553517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 180/336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:31.592765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9a131-5f01-4f33-8bf3-69aff0c375a1 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:31.642918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:31.674515 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776129-8bda-4133-90e3-bc8f11e92a8a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:31.674727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776129-8bda-4133-90e3-bc8f11e92a8a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:31.675020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776129-8bda-4133-90e3-bc8f11e92a8a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:31.676407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 181/337] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:31.681797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:31.682087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:31.682370 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:31.713920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:31.715161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:31.771744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9a131-5f01-4f33-8bf3-69aff0c375a1 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:31.827610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:31.828749 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:31.828975 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:31.829253 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:31.849465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:31.859020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:31.860128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:31.861472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 157/338] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:31.869147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:31.885903 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 182/339] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:31.923889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:32.025085 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:32.028825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529f40e-168e-410e-aaf5-e525308dbd1d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:32.067835 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:32.068516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.068806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.069096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.069839 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] RBAC: Adding query filter params (name=member) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:32.070152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:32.071585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:32.080899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 158/340] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:32.087850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:32.151334 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:32.156837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d891bc-da76-4fc5-8375-b6e28678a639 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:32.230197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d2dc-28c9-42f5-923a-42ab2578002f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:32.255482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1224-4e63-4c62-8b82-6222dedaf903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:32.256758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1224-4e63-4c62-8b82-6222dedaf903 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.257277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1224-4e63-4c62-8b82-6222dedaf903 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.257752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1224-4e63-4c62-8b82-6222dedaf903 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.275471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:32.276054 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.276347 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.276638 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.285534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a1224-4e63-4c62-8b82-6222dedaf903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f23a1224-4e63-4c62-8b82-6222dedaf903 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:32.298024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:32.299139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:32.300058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 183/341] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:32.300869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13379-f5e3-40c5-ab7d-2bdd8bb6f2c4 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.300869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13379-f5e3-40c5-ab7d-2bdd8bb6f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.301866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13379-f5e3-40c5-ab7d-2bdd8bb6f2c4 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.314323 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 184/342] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:32.315018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13379-f5e3-40c5-ab7d-2bdd8bb6f2c4 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:32.342998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:32.445102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:32.447169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:32.491077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13379-f5e3-40c5-ab7d-2bdd8bb6f2c4 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:32.559564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:32.560166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.560517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.560804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.561800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:32.562117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:32.563545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d5a98-8327-4fa1-8870-4ffcb95cfe58 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:32.582571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 185/343] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:32.583668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.583968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.584253 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.617321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:32.618594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:32.652231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 159/344] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:32.653109 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:32.659900 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:32.773543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 186/345] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:32.773543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:32.785414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:32.882682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754ad31-8fa6-4c68-8e7d-e3e69def9024 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:32.939860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd7135-af41-4d95-a564-257d7eb63531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:32.940538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7135-af41-4d95-a564-257d7eb63531 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:32.940821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7135-af41-4d95-a564-257d7eb63531 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:32.941097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7135-af41-4d95-a564-257d7eb63531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:32.990367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4407-cb07-4e99-a992-9131e94e7846 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.033438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.035807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.036102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.036386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.037646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.039148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.041301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 187/346] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:32 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:33.042227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.042827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd7135-af41-4d95-a564-257d7eb63531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.044533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd7135-af41-4d95-a564-257d7eb63531 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.076586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:33.122006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:33.174838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 160/347] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:33.174838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0768d-6093-406c-ad4b-dc87fea609da None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.174838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0768d-6093-406c-ad4b-dc87fea609da None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.174838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0768d-6093-406c-ad4b-dc87fea609da None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.174838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 161/348] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:33.175343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0768d-6093-406c-ad4b-dc87fea609da None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.186274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6bcc-2c54-470d-a8a5-14df77bbc625 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.233379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017725e7-7556-40a7-b900-ef78be17833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.234333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017725e7-7556-40a7-b900-ef78be17833a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.234618 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017725e7-7556-40a7-b900-ef78be17833a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.235121 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017725e7-7556-40a7-b900-ef78be17833a None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.251818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017725e7-7556-40a7-b900-ef78be17833a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-017725e7-7556-40a7-b900-ef78be17833a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:33.260355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:33.261645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:33.262763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 188/349] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:33.265018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adeb7f-80d9-439e-8c4e-68ad3050465a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.265018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adeb7f-80d9-439e-8c4e-68ad3050465a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.265183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adeb7f-80d9-439e-8c4e-68ad3050465a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.266727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 189/350] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:33.268267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adeb7f-80d9-439e-8c4e-68ad3050465a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.314577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0768d-6093-406c-ad4b-dc87fea609da None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.362928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0c8fb-5398-4a86-a65b-647777b58fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.364614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0c8fb-5398-4a86-a65b-647777b58fde None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.365125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0c8fb-5398-4a86-a65b-647777b58fde None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.365618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0c8fb-5398-4a86-a65b-647777b58fde None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.370336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:33.375355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0c8fb-5398-4a86-a65b-647777b58fde None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.376923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0c8fb-5398-4a86-a65b-647777b58fde None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.383344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 162/351] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:33.383344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.383344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.383344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.400671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:33.402827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:33.405537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adeb7f-80d9-439e-8c4e-68ad3050465a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.430932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:33.457935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707684d-aa90-451a-845b-0fd6b945bcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.458906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707684d-aa90-451a-845b-0fd6b945bcc9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.459261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707684d-aa90-451a-845b-0fd6b945bcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.459603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707684d-aa90-451a-845b-0fd6b945bcc9 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.460851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707684d-aa90-451a-845b-0fd6b945bcc9 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.463832 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707684d-aa90-451a-845b-0fd6b945bcc9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.466853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 190/352] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:33.470155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.470155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.470155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.488859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:33.490042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:33.494211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 163/353] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:33.495109 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.574216 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 191/354] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:33.575130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.633748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cbd2-d2e9-47b8-8fdc-7e1d82936848 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.670623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:33.675575 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.676575 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.677087 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.677365 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.678144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] RBAC: Adding query filter params (name=member) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:33.678460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.679923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f879-f00a-4d40-a876-4d28dbbe1f6d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.689640 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 164/355] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:33.693080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59afc8-8eea-4613-9a04-aa1e367d4c76 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.693080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59afc8-8eea-4613-9a04-aa1e367d4c76 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.693080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59afc8-8eea-4613-9a04-aa1e367d4c76 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.693080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 165/356] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:33.693422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59afc8-8eea-4613-9a04-aa1e367d4c76 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.704298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecd197-4918-4854-b3fe-dc82aa1ad423 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.716954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:33.746511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.747280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.748617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.748617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.748825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=31ce85495e994b6895e8ca60bd617b79) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:33.749022 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.750724 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.756530 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 192/357] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:33.757603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.842436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59afc8-8eea-4613-9a04-aa1e367d4c76 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.893542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.894341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.894631 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.894970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.896215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:33.897697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:33.899986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3ef8c-d0a3-479a-9a2a-9e478d357c0d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:33.900300 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 166/358] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:33.901116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.952441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:33.953588 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:33.953877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:33.954155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:33.969476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:33.980806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:33.981873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 193/359] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:33.983395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:33.987568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.010168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.034590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87034e-65da-4a32-977e-97027dcec69d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.076898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7ac99-b705-4a57-b7dc-d282a25d665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.079073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7ac99-b705-4a57-b7dc-d282a25d665b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.079616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7ac99-b705-4a57-b7dc-d282a25d665b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.080131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7ac99-b705-4a57-b7dc-d282a25d665b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.093827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7ac99-b705-4a57-b7dc-d282a25d665b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-01b7ac99-b705-4a57-b7dc-d282a25d665b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:34.102847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:34.104143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 167/360] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:34.105268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.106103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.106103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.124596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d6a04-85e0-4b18-ba9c-33100e06f991 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.126917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:34.128124 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:34.168574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.169158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.169446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.169728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.222843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 168/361] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:34.222843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.270996 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:34.272485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:34.275180 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.321302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.354501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29299ad0-6729-45cf-a6ae-893b25aa7c4a None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.397748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.399008 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.399519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.400520 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.401582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=31ce85495e994b6895e8ca60bd617b79) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:34.402123 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:34.404051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:34.410475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 169/362] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:34.411593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.419421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 194/363] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:34.420291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.548444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c301c-c7de-4d09-b6d8-a39d859eab41 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.569233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fb641-72ef-4d73-b377-eb7df79562ca None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.571698 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.593464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.594925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.595703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.596230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.597242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:34.597771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:34.599721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:34.610970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 170/364] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:34.612298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.615487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.618554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.619281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.619570 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.619849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.620632 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:34.620954 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:34.622721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:34.633464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 195/365] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:34.634606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.754286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8fffe-2f86-4e1c-bd1f-3d60100e42e7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.761948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5d8e7-393c-4f3a-884c-51569c085e60 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.800891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.801735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.802033 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.802318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.806696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.807870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.808160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.808524 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:34.809809 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:34.811584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:34.813688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 196/366] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:34.814891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:34.815037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:34.823098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:34.824234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:34.825173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:34.829790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 171/367] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:34.830656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:34.857318 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.913717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:34.941011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e3665-ba69-491c-9b24-5e6327558c9e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.968263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a355e9-f75d-482f-8ab5-05773f3f41fe None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:34.982204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:34.982924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:34.983218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:34.983553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.021221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.022578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.026289 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.027171 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] PATH_INFO: `/v3/users/ef308338260c4edc8b72c582626c7ccb` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.028924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] RBAC: Authorizing `identity:get_user(user_id=ef308338260c4edc8b72c582626c7ccb)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.030840 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.033123 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 172/368] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/users/ef308338260c4edc8b72c582626c7ccb => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.034127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.091697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.093734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.139405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:35.184770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e2050-9625-4a53-adc8-dae24459db10 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.217388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:35.223760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 197/369] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:35.224973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.225163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.226044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.226335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.226616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.228032 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.229490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.231441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 173/370] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.232219 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.333571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c868-0342-4b8f-808f-afe21fd3d437 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.344114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e65d1-cc3e-4f19-b91d-3d369f3dc572 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.364155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:35.370038 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.370718 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.371027 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.371308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.372326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:35.372838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.374678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.383938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.384608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.384789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 198/371] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.384900 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.385157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.385680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.386075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] RBAC: Adding query filter params (role.id=bc71484c5b9349a396d02d7c85bb5712, user.id=ef308338260c4edc8b72c582626c7ccb, scope.system=all) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:35.386399 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.387878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.401475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 174/372] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/role_assignments?user.id=ef308338260c4edc8b72c582626c7ccb&scope.system=all&role.id=bc71484c5b9349a396d02d7c85bb5712 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.402331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.500111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:35.504291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77439f8c-9d4c-4a6e-aba6-1546e22e45f4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.543079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.544028 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.544282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.544529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.545842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.547379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.549486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 199/373] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.550346 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.564894 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c59b-c1d0-4e7e-9871-b26377beb60d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.607516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.608117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.608407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.608691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.609549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:35.609934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.611474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.617967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 175/374] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.618881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.621525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:35.670017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419d48a-9de2-4b3c-8e60-7e7c666936e4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.713514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.714181 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.714468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.714747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.750014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfaed4-493b-4b28-a618-3ad8f798f58b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:35.780413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:35.804172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:35.805619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:35.805922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:35.806203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:35.808985 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.810743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.812760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 176/375] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:35.820086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:35.892047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:35.893988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:35.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:36.021619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 200/376] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:36.027897 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:36.057709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10822-e4a4-40b6-b4b1-d74ecbf30080 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:36.119051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:36.119728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.120009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.120291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.121137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:36.121454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:36.124367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:36.139450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 177/377] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:35 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 260 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:36.167228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b2a55-2f2e-41f6-a4d0-5f316a376839 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:36.228229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:36.229138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.229422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.229698 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] PATH_INFO: `/v3/projects/a9b820082b0b41198dbb6712a90e71d2` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.231155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] RBAC: Authorizing `identity:get_project(project_id=a9b820082b0b41198dbb6712a90e71d2)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:36.239534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:36.241526 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 201/378] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:36 2022] GET /identity/v3/projects/a9b820082b0b41198dbb6712a90e71d2 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:36.247954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:36.330942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:36.387220 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede9b3-a558-468b-b02c-176f0621e59d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:36.423012 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ec985-9b2f-4db0-add8-b2d3d5b58d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:36.423805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec985-9b2f-4db0-add8-b2d3d5b58d9e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.424092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec985-9b2f-4db0-add8-b2d3d5b58d9e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.424375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec985-9b2f-4db0-add8-b2d3d5b58d9e None admin] PATH_INFO: `/v3/groups/d955c45ad6cc466ca27992090bb41b75` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.429573 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ec985-9b2f-4db0-add8-b2d3d5b58d9e None admin] RBAC: Authorizing `identity:get_group(group_id=d955c45ad6cc466ca27992090bb41b75)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:36.431677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ec985-9b2f-4db0-add8-b2d3d5b58d9e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:36.433721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 178/379] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:36 2022] GET /identity/v3/groups/d955c45ad6cc466ca27992090bb41b75 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:36.439467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:36.457115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50734f2-7015-4df1-96ad-4e9c0adf9dad None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.457466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50734f2-7015-4df1-96ad-4e9c0adf9dad None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.457684 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50734f2-7015-4df1-96ad-4e9c0adf9dad None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.459785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 179/380] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:36.467023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.467317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.467894 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.492422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:36.494181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:36.503127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:36.604707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bec91-88f7-4261-9634-edb92b0f50ce None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:36.644517 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 180/381] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:36.651491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:36.652169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.652457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.652739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.653601 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] RBAC: Adding query filter params (group.id=d955c45ad6cc466ca27992090bb41b75, role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=a9b820082b0b41198dbb6712a90e71d2) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:36.653908 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:36.655445 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:36.662021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 202/382] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:36 2022] GET /identity/v3/role_assignments?group.id=d955c45ad6cc466ca27992090bb41b75&scope.project.id=a9b820082b0b41198dbb6712a90e71d2&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:36.701228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:36.780335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:36.866776 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1148d65-5461-4fca-93aa-1628ffb314c3 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:36.925871 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:36.926683 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:36.926998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:36.927280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:36.942195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:36.950649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:36.951762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:36.952730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 181/383] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:36.958737 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:37.060490 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:37.067360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613c2f-0456-42da-b2a9-bf8f1acef78f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:37.107997 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:37.108684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.108973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.109257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.110030 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:37.110344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:37.111789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:37.121319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 203/384] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:37.127164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:37.233692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9410160-f0fa-40ad-ae5a-32d4e2ece4f6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:37.240912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:37.270067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc683d-6658-4b9a-84aa-57cc3c6ff1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:37.270969 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc683d-6658-4b9a-84aa-57cc3c6ff1a7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.271255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc683d-6658-4b9a-84aa-57cc3c6ff1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.271537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc683d-6658-4b9a-84aa-57cc3c6ff1a7 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.272736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc683d-6658-4b9a-84aa-57cc3c6ff1a7 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:37.274223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc683d-6658-4b9a-84aa-57cc3c6ff1a7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:37.276221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 182/385] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:37 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:37.281719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:37.288090 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2e618-54c4-4714-b979-e9dee036811e None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.288670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2e618-54c4-4714-b979-e9dee036811e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.289184 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2e618-54c4-4714-b979-e9dee036811e None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.291893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 183/386] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:37.297522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.298058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.298554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.317477 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:37.319209 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:37.416108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 184/387] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:37.421506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a0937-417a-49a6-9acd-2220e73b9907 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:37.454089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:37.462965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:37.463913 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.464206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.464489 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.467573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:37.471122 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:37.474198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 204/388] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:37 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:37.483937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:37.528040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:37.612315 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef56a3-52d8-42a2-9473-dcc1e5d35e16 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:37.620969 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:37.673220 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9cc06-3e71-4a4a-a889-2a3f56b20c62 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:37.688284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:37.689115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.689400 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.689674 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.709188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:37.718023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:37.719116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:37.720064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 185/389] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:37.726609 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:37.759611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:37.760437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.760726 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.761008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79/groups/10f6b999829245a0afa851d1cca3da3c/roles/984272f4fd594c06a9f31fcf059131e3` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.768110 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=31ce85495e994b6895e8ca60bd617b79, group_id=10f6b999829245a0afa851d1cca3da3c, role_id=984272f4fd594c06a9f31fcf059131e3)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:37.769594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:37.805068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 205/390] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:23:37 2022] PUT /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79/groups/10f6b999829245a0afa851d1cca3da3c/roles/984272f4fd594c06a9f31fcf059131e3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:37.865507 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c659f-acfe-4173-a113-43e536adbc25 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:37.903708 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:37.904394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:37.904678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:37.904957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:37.905720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:37.906028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:37.907473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:37.916694 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 186/391] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:37.923579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:38.050701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:38.067747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc372cd2-8578-44d2-96e7-9ed9a2f72f90 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:38.119009 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:38.119972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.120257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.120597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.127731 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:38.129257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:38.131487 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 206/392] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:37 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:38.137364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:38.192845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:38.275353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276af6-77f8-490d-be3e-8a3083bf8a68 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:38.311570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f372-a3b5-4ddb-8260-681399ce20f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:38.312422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f372-a3b5-4ddb-8260-681399ce20f9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.312712 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f372-a3b5-4ddb-8260-681399ce20f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.312990 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f372-a3b5-4ddb-8260-681399ce20f9 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.314232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89f372-a3b5-4ddb-8260-681399ce20f9 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:38.315723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89f372-a3b5-4ddb-8260-681399ce20f9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:38.317460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 187/393] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:38 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:38.323443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:38.441769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565fc82-9971-442b-8419-9c1eadf8cea2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:38.487379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934f84-a39f-499c-a8ea-4b7ab746057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:38.489973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934f84-a39f-499c-a8ea-4b7ab746057d None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.490260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934f84-a39f-499c-a8ea-4b7ab746057d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.490540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934f84-a39f-499c-a8ea-4b7ab746057d None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79/groups/10f6b999829245a0afa851d1cca3da3c/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.496634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934f84-a39f-499c-a8ea-4b7ab746057d None admin] RBAC: Authorizing `identity:create_grant(project_id=31ce85495e994b6895e8ca60bd617b79, group_id=10f6b999829245a0afa851d1cca3da3c, role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:38.498111 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934f84-a39f-499c-a8ea-4b7ab746057d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:38.525430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 207/394] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:23:38 2022] PUT /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79/groups/10f6b999829245a0afa851d1cca3da3c/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:38.866665 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03478-6b30-4be3-8097-89acdcabd6e3 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.867216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03478-6b30-4be3-8097-89acdcabd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.867365 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03478-6b30-4be3-8097-89acdcabd6e3 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.868832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 188/395] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:38.874636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.875114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.875214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.896469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:38.897690 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:38.906764 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:38.936219 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed724-40a7-4b12-a7ad-87e57f621a27 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.936548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed724-40a7-4b12-a7ad-87e57f621a27 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.936802 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed724-40a7-4b12-a7ad-87e57f621a27 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.938458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 189/396] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:38.944778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:38.945071 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:38.945883 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:38.968676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:38.969888 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:38.992211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 208/397] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:39.033498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.072128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 190/398] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:39.122515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.165336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:39.190080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d1a40-fe07-4464-abaa-bced02733e43 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.243957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e06f5-7873-4046-8325-edde98ec04a1 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.259462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.260283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.260572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.260854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.279514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:39.288135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:39.289785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:39.290734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 209/399] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:39.294485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.295529 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.295956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.296370 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.299534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.307099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:39.309130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:39.317808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:39.319228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:39.320185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:39.323628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 191/400] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:39.335771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.505179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:39.506864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459dada-483c-4fe5-adb8-0be9cd240a6f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.538616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fac4b-bd0a-4aea-8429-40d61788b39b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.561216 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.562307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.562947 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.563438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.564482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:39.567427 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:39.567427 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:39.576608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.577419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.577556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.577932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.578140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 210/401] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:39.578601 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:39.582886 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:39.582886 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:39.584185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.589916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 192/402] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:39.595594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.660600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:39.706236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a292d9-f862-4f89-845d-174ddfc22e6f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.712176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeda7a-45af-4bee-bd11-afbd1191707a None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.744010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1d862-4dcb-4a7d-ac7b-4f0467e75c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.744875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1d862-4dcb-4a7d-ac7b-4f0467e75c1a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.745155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1d862-4dcb-4a7d-ac7b-4f0467e75c1a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.745429 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1d862-4dcb-4a7d-ac7b-4f0467e75c1a None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.746640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1d862-4dcb-4a7d-ac7b-4f0467e75c1a None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:39.748150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1d862-4dcb-4a7d-ac7b-4f0467e75c1a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:39.752961 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 211/403] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:39.754957 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79d8c1-8434-4757-adf6-b39816523668 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.755541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79d8c1-8434-4757-adf6-b39816523668 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.756045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79d8c1-8434-4757-adf6-b39816523668 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.758622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 212/404] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:39.759245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821149c-d15d-4662-9685-4a7f7536aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.759877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79d8c1-8434-4757-adf6-b39816523668 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.760236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821149c-d15d-4662-9685-4a7f7536aea3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.760516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821149c-d15d-4662-9685-4a7f7536aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.760821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821149c-d15d-4662-9685-4a7f7536aea3 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.762395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821149c-d15d-4662-9685-4a7f7536aea3 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:39.764222 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821149c-d15d-4662-9685-4a7f7536aea3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:39.767184 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 193/405] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:39.768452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.768735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.769014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.789251 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:39.793423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:39.808313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:39.889910 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79d8c1-8434-4757-adf6-b39816523668 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:39.896569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 194/406] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:39.898467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:39.921153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:39.926503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:39.927448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:39.927728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:39.928004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:39.929628 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:39.932094 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:39.933793 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 213/407] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:39.939129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.029881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147e854-2a66-4df5-bbbd-4eb17fa8f2a0 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.062033 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36480a-29a5-44be-8166-1ed2f7c888f5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.069724 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.073688 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.073971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.074245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.076629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:40.078063 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:40.080454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 195/408] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:40.081308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.097079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:40.112658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.114428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.114993 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.115651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.133808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:40.143132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:40.144267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:40.145217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:40.145936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 214/409] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:40.146753 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.203098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cff9a-e7d9-4a07-8c4f-fb8fefd9258f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.217447 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:40.242845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.244241 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.244834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.245321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/groups/10f6b999829245a0afa851d1cca3da3c/roles/984272f4fd594c06a9f31fcf059131e3` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.247659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f32a0f6e0ae4f0aaeb4113f675da332, group_id=10f6b999829245a0afa851d1cca3da3c, role_id=984272f4fd594c06a9f31fcf059131e3)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:40.249647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:40.265250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7e23-a759-4a20-bf55-405bdd18c106 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.266467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 196/410] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:23:40 2022] PUT /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/groups/10f6b999829245a0afa851d1cca3da3c/roles/984272f4fd594c06a9f31fcf059131e3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:40.267873 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.335165 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.336288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.336510 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.336779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/groups/10f6b999829245a0afa851d1cca3da3c/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.342200 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] RBAC: Authorizing `identity:create_grant(project_id=0f32a0f6e0ae4f0aaeb4113f675da332, group_id=10f6b999829245a0afa851d1cca3da3c, role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:40.344103 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:40.354322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:40.381545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 215/411] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:23:40 2022] PUT /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332/groups/10f6b999829245a0afa851d1cca3da3c/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:23:40.393242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10b15-b6bf-4c15-8188-a39d6d26ac51 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.439188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.439994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.440284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.440561 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.441439 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:40.441754 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:40.443367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:40.453903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 197/412] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:40.459779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.596222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9a7c-4857-457f-a8b4-42281e3cfcbf None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.620364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:40.636600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734d37d-0fc4-4269-97b1-a18ee9cb57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.637983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d37d-0fc4-4269-97b1-a18ee9cb57c5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.638943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d37d-0fc4-4269-97b1-a18ee9cb57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.639560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d37d-0fc4-4269-97b1-a18ee9cb57c5 None admin] PATH_INFO: `/v3/groups/d955c45ad6cc466ca27992090bb41b75` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.640897 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734d37d-0fc4-4269-97b1-a18ee9cb57c5 None admin] RBAC: Authorizing `identity:get_group(group_id=d955c45ad6cc466ca27992090bb41b75)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:40.642386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734d37d-0fc4-4269-97b1-a18ee9cb57c5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:40.644493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 216/413] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:40 2022] GET /identity/v3/groups/d955c45ad6cc466ca27992090bb41b75 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:40.650098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.713069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f40e-0563-4ade-a510-934bf45ba2fe None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.713431 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f40e-0563-4ade-a510-934bf45ba2fe None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.713643 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f40e-0563-4ade-a510-934bf45ba2fe None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.715834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 217/414] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:40.721267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.721558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.722351 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.746200 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:40.747495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:40.772966 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164487bd-ac24-489f-a2be-d3d32db7095d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:40.821773 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:40.823081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:40.823948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:40.825183 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] PATH_INFO: `/v3/projects/a9b820082b0b41198dbb6712a90e71d2` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:40.827715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] RBAC: Authorizing `identity:get_project(project_id=a9b820082b0b41198dbb6712a90e71d2)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:40.830714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:40.841372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 198/415] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:40 2022] GET /identity/v3/projects/a9b820082b0b41198dbb6712a90e71d2 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:40.844420 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:40.871156 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:40.875541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 218/416] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:40.935039 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.035621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438c23-d392-4ea9-bd88-026a639a909b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.107979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a881a9-892a-4a9f-ad00-8e12475b8c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.109432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a881a9-892a-4a9f-ad00-8e12475b8c1a None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.109897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a881a9-892a-4a9f-ad00-8e12475b8c1a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.110471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a881a9-892a-4a9f-ad00-8e12475b8c1a None admin] PATH_INFO: `/v3/projects/a9b820082b0b41198dbb6712a90e71d2/groups/d955c45ad6cc466ca27992090bb41b75/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.116253 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a881a9-892a-4a9f-ad00-8e12475b8c1a None admin] RBAC: Authorizing `identity:create_grant(project_id=a9b820082b0b41198dbb6712a90e71d2, group_id=d955c45ad6cc466ca27992090bb41b75, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:41.117754 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a881a9-892a-4a9f-ad00-8e12475b8c1a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:41.142664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 199/417] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:23:40 2022] PUT /identity/v3/projects/a9b820082b0b41198dbb6712a90e71d2/groups/d955c45ad6cc466ca27992090bb41b75/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:23:41.143820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d32e5-25ea-4a59-881e-a7de057a76be None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.175966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:41.180490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59686e-2cd2-43ba-9072-85893bb2e0cf None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.180804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59686e-2cd2-43ba-9072-85893bb2e0cf None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.181149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59686e-2cd2-43ba-9072-85893bb2e0cf None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.183374 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 200/418] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:41.189764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.190444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.190980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.191549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.192356 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.192638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.192913 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.205678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:41.216772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:41.217973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:41.218953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 219/419] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:41.222183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.236004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:41.239133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:41.342974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b0857-d898-4492-83f9-520b41cfd22f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.382290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.383621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.384275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.384572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.385622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:41.385934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:41.387523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:41.399045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:41.399400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 220/420] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:41.407820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.419584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 201/421] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:41.443738 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.460080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:41.529426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c340-a557-4442-88e4-e304c01ad80d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.551641 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fa2b-dfcc-4d6b-8dc9-0edb708502a9 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.568087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.568747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.569048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.569322 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.590357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.591607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.592122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.592615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.604209 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:41.612713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:41.613784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:41.614729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:41.617157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 202/422] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:41.622961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.650199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:41.651793 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:41.678941 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:41.698647 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:41.729174 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f40f5-7627-47fc-b2ce-1f9f0c6349ad None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.764770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.765696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.766164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.766620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.767577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:41.767841 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 221/423] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:41.768229 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:41.769866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:41.773522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.779402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 203/424] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:41.784966 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.893139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db632-b879-4310-9d5a-6f34c23a575a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.896584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f87ba-4727-47d9-9022-43c74d5b79b2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:41.911687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:41.934443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.935727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.936728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.937227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.939651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:41.941511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:41.943950 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 222/425] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:41.950106 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:41.953204 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:41.953890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:41.954170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:41.954458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:41.963741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:42.066560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fa50-a5c3-42be-a49c-5829fedbcca8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:42.092102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:42.093502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:42.106990 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:42.108202 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:42.108765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:42.109278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:42.110694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:42.112493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:42.118880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 223/426] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:42.121384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:42.211966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:42.254036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9262e3-1861-4810-85bb-04f58a156030 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:42.258856 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 204/427] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:23:42.263862 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:42.280859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:42.321946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84916aa-288a-4909-817d-daa832264543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:42.322966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84916aa-288a-4909-817d-daa832264543 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:42.323418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84916aa-288a-4909-817d-daa832264543 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:42.323873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84916aa-288a-4909-817d-daa832264543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:42.324888 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84916aa-288a-4909-817d-daa832264543 None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=31ce85495e994b6895e8ca60bd617b79) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:42.325367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84916aa-288a-4909-817d-daa832264543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:42.327331 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84916aa-288a-4909-817d-daa832264543 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:42.343974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 224/428] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:42 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:42.425821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee75f-eb6f-4c5a-87d8-488bc26089fd None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:42.481751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:42.482556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:42.482866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:42.483418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] PATH_INFO: `/v3/projects/31ce85495e994b6895e8ca60bd617b79` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:42.484736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] RBAC: Authorizing `identity:get_project(project_id=31ce85495e994b6895e8ca60bd617b79)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:42.486215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:42.488029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 205/429] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:42 2022] GET /identity/v3/projects/31ce85495e994b6895e8ca60bd617b79 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:42.494178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84916aa-288a-4909-817d-daa832264543 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:42.651271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84916aa-288a-4909-817d-daa832264543 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:42.687340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fbe84-57ba-4f4b-ba4e-43d0b8203496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:42.688201 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fbe84-57ba-4f4b-ba4e-43d0b8203496 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:42.688481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fbe84-57ba-4f4b-ba4e-43d0b8203496 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:42.688755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fbe84-57ba-4f4b-ba4e-43d0b8203496 None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:42.689941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fbe84-57ba-4f4b-ba4e-43d0b8203496 None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:42.691435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fbe84-57ba-4f4b-ba4e-43d0b8203496 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:42.693478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 225/430] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:42 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:42.699889 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:42.798382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:42.823275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3fff7-8d7d-48ea-8ccf-a6ae7772acdf None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:42.865235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:42.865924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:42.866210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:42.866492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:42.867981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=31ce85495e994b6895e8ca60bd617b79) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:42.868302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:42.869891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bace5-02a8-4cea-96de-5920001a5900 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:42.879929 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 206/431] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:42 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=31ce85495e994b6895e8ca60bd617b79&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:43.101968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47c0c-7623-4c62-be66-aec577e5a91f None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.102494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47c0c-7623-4c62-be66-aec577e5a91f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.102494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47c0c-7623-4c62-be66-aec577e5a91f None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.104104 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 226/432] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:43.109751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f7a2-c4fe-4445-9dfc-7e3ffaf47f64 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.110198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f7a2-c4fe-4445-9dfc-7e3ffaf47f64 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.110314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f7a2-c4fe-4445-9dfc-7e3ffaf47f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.130403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-2261f7a2-c4fe-4445-9dfc-7e3ffaf47f64 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:43.131676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-2261f7a2-c4fe-4445-9dfc-7e3ffaf47f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:43.211468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 207/433] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:43.234690 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47c0c-7623-4c62-be66-aec577e5a91f None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.246684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:43.347289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47c0c-7623-4c62-be66-aec577e5a91f None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:43.387683 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd5338-a590-4de5-8b94-4d4491032ac0 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.387896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd5338-a590-4de5-8b94-4d4491032ac0 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.388182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd5338-a590-4de5-8b94-4d4491032ac0 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.388446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:43.389474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.389845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 208/434] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:43.390207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.390706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] PATH_INFO: `/v3/roles/member` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.395650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.395938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.396218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.403941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:43.413592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:43.415264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:43.416209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 227/435] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:43.416984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:43.419757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:43.421156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.509269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:43.515680 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 209/436] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:43.538803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.546834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:43.553021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd35f-b545-4b05-ac99-f93a9132288a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:43.590470 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:43.591495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.592057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.592656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.593493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:43.593805 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:43.595226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:43.608923 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 228/437] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:43.609804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.644970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77bff2-b546-4664-b9c3-aa580a76e3cb None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:43.681123 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:43.681955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.682236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.682616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.693737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:43.702621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:43.703719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:43.709721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 210/438] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:43.710799 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.723710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599362f-383d-4b76-b27c-e197cd8f02c1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:43.754804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:43.765548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:43.766222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.766513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.766816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.785093 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:43.825725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc087f-7943-4696-95bf-85121869fa9d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:43.837899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:43.839449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:43.872155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:43.872848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:43.873129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:43.873409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:43.874462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:43.874816 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:43.876237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:43.890739 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 211/439] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:43.891870 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.950130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 229/440] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:43.955439 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:43.995341 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.003029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc688cb-2a41-4280-bb80-0c7f9f4f0a03 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.033845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.045210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ece07c-1ba7-42d4-b90e-44cb9b0bf12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.045928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece07c-1ba7-42d4-b90e-44cb9b0bf12d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.046224 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece07c-1ba7-42d4-b90e-44cb9b0bf12d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.046926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece07c-1ba7-42d4-b90e-44cb9b0bf12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.071743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1483c-4f2b-4c3b-81e9-e129e6a66a66 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.105238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089409-43c0-4291-981e-1c1744942f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.106177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089409-43c0-4291-981e-1c1744942f06 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.106465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089409-43c0-4291-981e-1c1744942f06 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.106742 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089409-43c0-4291-981e-1c1744942f06 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.107968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089409-43c0-4291-981e-1c1744942f06 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.109448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089409-43c0-4291-981e-1c1744942f06 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.111204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 230/441] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:44.112375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ebf-859d-4d30-80af-a0f3357db219 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.112658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ebf-859d-4d30-80af-a0f3357db219 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.112933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ebf-859d-4d30-80af-a0f3357db219 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.114162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 231/442] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:44.116524 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ebf-859d-4d30-80af-a0f3357db219 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.120134 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ece07c-1ba7-42d4-b90e-44cb9b0bf12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.121598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ece07c-1ba7-42d4-b90e-44cb9b0bf12d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.217006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.221019 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 212/443] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:44.222465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ebf-859d-4d30-80af-a0f3357db219 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.222639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.223104 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.223530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.240418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:44.241611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:44.257646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.259048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.259332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.259611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.260801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.262288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.263954 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 232/444] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:44.264836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.265103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.313035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 213/445] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:44.313869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.375399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f5004-1aa7-4688-952a-971c8caec23c None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.409254 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.410117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.410399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.410678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] PATH_INFO: `/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.411903 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] RBAC: Authorizing `identity:get_project(project_id=0f32a0f6e0ae4f0aaeb4113f675da332)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.413354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.415826 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 233/446] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/projects/0f32a0f6e0ae4f0aaeb4113f675da332 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:44.416503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.422945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14cbc-f9bb-440e-a87c-182d9df04458 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.450653 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.457030 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.457687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.457969 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.458239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.459104 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=984272f4fd594c06a9f31fcf059131e3, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:44.459417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.461470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.467521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 214/447] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=984272f4fd594c06a9f31fcf059131e3 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:44.468251 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.494254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.540341 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85b73-f2ce-4db4-90c3-bf2415c16305 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.581623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.582433 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.582718 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.583023 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.587827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c6c24-1d32-4d9a-ae05-a01f9382b418 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.594887 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:44.603437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:44.604750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:44.605732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 234/448] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:44.610625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.630401 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.631316 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.631597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.631873 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] PATH_INFO: `/v3/groups/10f6b999829245a0afa851d1cca3da3c` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.633651 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] RBAC: Authorizing `identity:get_group(group_id=10f6b999829245a0afa851d1cca3da3c)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.635150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.637033 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 215/449] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/groups/10f6b999829245a0afa851d1cca3da3c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:44.642650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.716011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.727062 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ae9e-d418-4098-9180-70832864aa45 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.755486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:44.768680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.769352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.769638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.769916 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.770672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:44.771026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.771870 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff6cbc-3168-4485-bc9b-6914d38d343d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.772417 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.782372 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 235/450] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:44.788363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:44.817769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.818844 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.818844 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.819083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.819884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] RBAC: Adding query filter params (group.id=10f6b999829245a0afa851d1cca3da3c, role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:44.820205 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:44.822359 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:44.828537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 216/451] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/role_assignments?group.id=10f6b999829245a0afa851d1cca3da3c&scope.project.id=0f32a0f6e0ae4f0aaeb4113f675da332&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:44.920284 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92fdc7-68c5-4b44-bac6-2c5115ea2241 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:44.957849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:44.958535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:44.958819 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:44.959108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:44.985920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:45.031612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:45.033107 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:45.141739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 236/452] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:23:45.148777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:45.261347 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad6f9-1a62-4dba-9a8f-fae472b94edc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:45.294141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:45.295020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:45.295296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:45.295570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] PATH_INFO: `/v3/projects/a9b820082b0b41198dbb6712a90e71d2` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:45.296736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] RBAC: Authorizing `identity:get_project(project_id=a9b820082b0b41198dbb6712a90e71d2)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:45.298161 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:45.299868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 217/453] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:23:45 2022] GET /identity/v3/projects/a9b820082b0b41198dbb6712a90e71d2 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:45.305557 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:45.359762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:45.403091 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a903fbf-6714-429f-8b2e-a5e656467e92 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:45.435261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61146f61-6004-4f5d-a553-d12671d54b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:45.436099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61146f61-6004-4f5d-a553-d12671d54b94 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:45.436380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61146f61-6004-4f5d-a553-d12671d54b94 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:45.436654 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61146f61-6004-4f5d-a553-d12671d54b94 None admin] PATH_INFO: `/v3/groups/d955c45ad6cc466ca27992090bb41b75` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:45.437827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61146f61-6004-4f5d-a553-d12671d54b94 None admin] RBAC: Authorizing `identity:get_group(group_id=d955c45ad6cc466ca27992090bb41b75)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:45.439312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61146f61-6004-4f5d-a553-d12671d54b94 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:45.440910 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 237/454] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:23:45 2022] GET /identity/v3/groups/d955c45ad6cc466ca27992090bb41b75 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:45.447229 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:45.480146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:45.553984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff8476-c3ca-4b13-8566-14826de4b871 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:45.587333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:45.587986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:45.588278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:45.588558 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:45.589393 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] RBAC: Adding query filter params (group.id=d955c45ad6cc466ca27992090bb41b75, role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=a9b820082b0b41198dbb6712a90e71d2) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:45.589709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:45.591186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3404e-d7f3-404a-9518-c9eda21edff9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:45.596933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 218/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:23:45 2022] GET /identity/v3/role_assignments?group.id=d955c45ad6cc466ca27992090bb41b75&scope.project.id=a9b820082b0b41198dbb6712a90e71d2&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:48.286360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7fef6-71e0-4f16-8157-6a6988634d60 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:48.286935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7fef6-71e0-4f16-8157-6a6988634d60 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:48.286935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7fef6-71e0-4f16-8157-6a6988634d60 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:48.288656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 238/456] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:48.293971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b78daa-d960-4808-8a13-c1a2b946e495 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:48.294390 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b78daa-d960-4808-8a13-c1a2b946e495 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:48.294568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b78daa-d960-4808-8a13-c1a2b946e495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:48.327994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-60b78daa-d960-4808-8a13-c1a2b946e495 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:48.329760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-60b78daa-d960-4808-8a13-c1a2b946e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:48.457211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 219/457] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:48.499227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7fef6-71e0-4f16-8157-6a6988634d60 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:48.644364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7fef6-71e0-4f16-8157-6a6988634d60 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:48.644553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f056c14-0dab-454f-9459-913974ea6a35 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:48.644643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f056c14-0dab-454f-9459-913974ea6a35 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:48.644897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f056c14-0dab-454f-9459-913974ea6a35 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:48.657565 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 220/458] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:48.660578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:48.661224 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:48.661730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:48.674298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:48.694037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:48.695348 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:48.695348 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:48.695537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:48.705254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:48.706443 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:48.721365 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:48.728304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:48.730559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:48.776491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:48.777592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:48.779866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:48.779866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:48.779866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:48.779866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:48.779866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 239/459] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:48.786147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:48.822411 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 221/460] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:48.863037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:48.972326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd36c-f419-494d-91b4-6e451ded5fc4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:48.986593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265cdc-f4c0-41b9-ba53-e0f855e572f8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.019912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.020986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.021433 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.021880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.023540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:49.024027 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.024168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.024917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.025211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.025485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.026241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbc7cd-408a-4d0f-955b-53a112204520 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.036375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.037819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.046063 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:49.056782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 240/461] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:49.058408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:49.059602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:49.060805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:49.060805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:49.060805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:49.060805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:49.061711 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec9d4-d609-425c-93a3-f7577a1d0d6a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.062162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec9d4-d609-425c-93a3-f7577a1d0d6a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.062821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec9d4-d609-425c-93a3-f7577a1d0d6a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.063041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 222/462] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:49.063811 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:49.071411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 241/463] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:49.072292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ec9d4-d609-425c-93a3-f7577a1d0d6a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:49.129223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:49.184015 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e0f3d-3576-4dd0-82eb-00e577b3a940 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.203551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ec9d4-d609-425c-93a3-f7577a1d0d6a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.224972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11828-a9c9-4660-b1fa-87432fb95988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.226093 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11828-a9c9-4660-b1fa-87432fb95988 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.226593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11828-a9c9-4660-b1fa-87432fb95988 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.227085 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11828-a9c9-4660-b1fa-87432fb95988 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.228000 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a11828-a9c9-4660-b1fa-87432fb95988 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.229858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a11828-a9c9-4660-b1fa-87432fb95988 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.241068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.242005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.242407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.242757 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.243810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:49.244186 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.245812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.254737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 223/464] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:49 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:49.256791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f78ff-cfb0-41e8-8c04-4a048db3f7b7 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.257917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f78ff-cfb0-41e8-8c04-4a048db3f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.258643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f78ff-cfb0-41e8-8c04-4a048db3f7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.271524 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 242/465] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:49.272741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:49.288676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-fc6f78ff-cfb0-41e8-8c04-4a048db3f7b7 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:49.292603 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-fc6f78ff-cfb0-41e8-8c04-4a048db3f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:49.423312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:49.456233 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 224/466] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:49.468200 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:49.477387 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c78c9d-60d8-4c71-a6d4-8bf88c8579ac None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.486026 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff983-94da-46cc-b9e8-ddf7acc4b530 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.486360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff983-94da-46cc-b9e8-ddf7acc4b530 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.486636 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff983-94da-46cc-b9e8-ddf7acc4b530 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.488349 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 225/467] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:23:49.494431 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.494771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.495025 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.515313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:49.516863 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:49.544996 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.545333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.545547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.545837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.546634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.548581 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.577608 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 243/468] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:49 2022] POST /identity/v3/users => generated 248 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:23:49.579753 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:49.606391 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 226/469] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:49.632396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:49.739939 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63554d69-5cfb-406e-9692-5f4f2c2ba4c1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.781261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510ed3-9a0a-4dd0-b506-a96c6e28bbc0 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.782305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.783261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.783614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.784279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.799955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.801079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:49.803605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f7fd435b-c244-4fba-8148-8e10e35eb0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:49.827377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:49.828522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:49.829535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:49.829535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:49.829535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:49.829535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:49.829535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 244/470] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:49.829838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18386dec-64c2-4117-91b5-48b8592cedc2 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.830447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:49.830589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18386dec-64c2-4117-91b5-48b8592cedc2 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.830927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18386dec-64c2-4117-91b5-48b8592cedc2 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.831820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.832294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.832585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 245/471] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:49.833029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.837436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18386dec-64c2-4117-91b5-48b8592cedc2 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:49.841664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:49.846003 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:49.847684 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-43c93f2f-1fc9-46d0-a6a8-6a8024325f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:49.872284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:49.875045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:49.876052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:49.876052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:49.876052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:49.876052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:49.876052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 227/472] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:49.880013 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:49.880671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:49.880962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:49.900981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:49.902179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:49.977153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18386dec-64c2-4117-91b5-48b8592cedc2 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:49.985816 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 228/473] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:49.986765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:50.025898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.027838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.028350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.028917 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.029910 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:50.030471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:50.032751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:50.050025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 246/474] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:50.051859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:50.099217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:50.107493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60742-4368-4a36-ae5d-96b4cdb9d8d8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:50.136854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:50.151755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.152490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.152780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.153057 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.153934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:50.154250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:50.155669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:50.174827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 229/475] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:50.174827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:50.198025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c220-8e19-4f16-95c2-3741227d8f7a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:50.238340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.239567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.240086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.240575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.242324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:50.244109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:50.252810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.sql.core [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:23:50.252810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:23:50.252810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [parameters: {'id': 'd0ad6000f5f14d83a2d9fe8b3a38164f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:23:50.252810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143652) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application conn.query(q) May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result.read() May 19 14:23:50.272350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return ref.to_dict() May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:23:50.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application next(self.gen) May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application yield resource May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application next(self.gen) May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise self.value May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application session.commit() May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:23:50.275816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.session.flush() May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application compat.raise_( May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:23:50.278060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:23:50.280366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application conn.query(q) May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result.read() May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:23:50.282554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [parameters: {'id': 'd0ad6000f5f14d83a2d9fe8b3a38164f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:50.284717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:23:50.288144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:50.292461 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2e30-3699-4d2b-a02e-b71e39833902 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:50.292635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 247/476] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:23:50 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:50.292635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:50.321212 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.321586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.321868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.322139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.322882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:50.324301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:50.347075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 230/477] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:50 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:50.348107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:50.365703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:50.420258 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ef689-f075-4fef-b261-00144cfca4df None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:50.451944 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:50.461422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07107ab3-331d-4589-9f33-0750d05e2b3e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:50.463938 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.464889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.465433 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.465927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.466960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:50.468836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:50.509619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 248/478] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:50 2022] POST /identity/v3/users => generated 249 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:50.509846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18bece-bcb9-4d4e-837e-8f435daa97eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.510561 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18bece-bcb9-4d4e-837e-8f435daa97eb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.510874 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18bece-bcb9-4d4e-837e-8f435daa97eb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.511158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18bece-bcb9-4d4e-837e-8f435daa97eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.526119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18bece-bcb9-4d4e-837e-8f435daa97eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ea18bece-bcb9-4d4e-837e-8f435daa97eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:50.539989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:50.541100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:50.542037 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 231/479] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:23:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:50.547883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:50.671014 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1e30-36dc-417e-8501-7d876d654e7b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:50.710381 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:50.711640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:50.711926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:50.712203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:50.712975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:50.713283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:50.714701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b0512-0248-4ede-8e63-8f887a1c9677 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:50.725160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 249/480] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:51.838239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f6bb1-e4ea-486d-8a7c-154bd85aa9f8 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:51.838841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f6bb1-e4ea-486d-8a7c-154bd85aa9f8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:51.838841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f6bb1-e4ea-486d-8a7c-154bd85aa9f8 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:51.850488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 232/481] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:51.853063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:51.853998 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:51.854435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:51.880005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:51.881205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:51.942002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:51.993208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 250/482] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:52.037944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f6bb1-e4ea-486d-8a7c-154bd85aa9f8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:52.135977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:52.180531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f6bb1-e4ea-486d-8a7c-154bd85aa9f8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:52.223736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:52.224565 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:52.224851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:52.225128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:52.243938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:52.252342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:52.253453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:52.254389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 233/483] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:52.260578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:52.396728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fa0da-ee85-4846-93e7-068e8ad3c438 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:52.442205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:52.442899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:52.443185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:52.443457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:52.444209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:52.444522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:52.446444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638df701-a7b0-4938-9fe9-1bf6b64bfda8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:52.458230 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 251/484] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:52.464458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:52.574931 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf018-a68e-48d2-9c20-620308225c35 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:52.579380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cada38-8c71-492b-8b05-4eeabfeb0e7b None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:52.579671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cada38-8c71-492b-8b05-4eeabfeb0e7b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:52.579953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cada38-8c71-492b-8b05-4eeabfeb0e7b None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:52.584189 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 252/485] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:52.587988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:52.588281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:52.588975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:52.608118 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:52.609317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:52.637466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:52.648962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:52.649455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:52.649703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:52.649993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:52.650279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:52.683669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:52.685150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:52.692612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 253/486] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:52.720088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:52.721110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:52.722105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:52.722105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:52.722105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:52.722105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:52.727211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 234/487] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:52.732747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:52.738605 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:52.902035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95a8c-df4c-488c-a9e7-ee5bf244929d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:52.920902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b188b-d390-4993-91da-8b3315af0a22 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:52.940521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:52.941722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:52.942228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:52.942714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:52.954621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:52.963182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:52.964307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:52.965271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:52.968436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 235/488] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:52.974839 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.005722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.006411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.006697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.007006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.007882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:53.008195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.009613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.032005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.037280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 254/489] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:53.043407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.100423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ae71e-244f-47d8-8d36-45fcb9fd2d34 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.103161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.146112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.147414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.148537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.149041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.150056 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:53.150615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.152373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.166845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 236/490] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:53.168584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.187774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6b2a-7235-4e16-bc34-3dae4a371fc3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.276060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.276874 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.277161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.277440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.284103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921ed3e-a192-4bcd-9ac2-45ac37697354 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.291944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.297326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.298908 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-132d798e-6d31-4dea-9d2b-29e3ff277666 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:23:53.315937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:53.317017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:53.318664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 255/491] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:53.319375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e8f2-b3e7-4785-a09d-57892a44f943 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.319375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e8f2-b3e7-4785-a09d-57892a44f943 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.319375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e8f2-b3e7-4785-a09d-57892a44f943 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.326278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 256/492] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:53.327237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e8f2-b3e7-4785-a09d-57892a44f943 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.328849 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.329897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.330464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.330997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.345282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.346761 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-1b863e4d-3705-4f23-ad81-b7aea217e288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:53.375150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:53.376273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:53.377261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:53.377261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:53.377261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:53.377261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:53.380729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 237/493] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:53.383152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.383612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.384048 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.407999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:53.410047 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:53.447034 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.466707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e8f2-b3e7-4785-a09d-57892a44f943 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.502834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 238/494] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:53.502834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.526080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.527428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.528376 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.529714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.530577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:53.530925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.532399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.576014 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 257/495] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:53.577327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.620209 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.634617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfecdb-9dc7-4a49-ae91-5c2c0545b0c5 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.670497 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.671134 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.671417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.671694 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.672422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:53.672730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.674092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfca15-4ed2-468c-8ec4-26ceddbf0bf0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.690133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 239/496] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:53.691510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18180d73-44d6-4cb8-96f1-a4148c90e756 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.691786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18180d73-44d6-4cb8-96f1-a4148c90e756 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.692057 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18180d73-44d6-4cb8-96f1-a4148c90e756 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.693319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ae57-c490-4815-842e-d8e41fc5fc4f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.698075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 240/497] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:53.698075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18180d73-44d6-4cb8-96f1-a4148c90e756 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.735391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.736289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.736657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.736941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.747620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:53.755729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:53.756960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 258/498] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:53.758880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:53.768648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.804649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18180d73-44d6-4cb8-96f1-a4148c90e756 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.838629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231ad11-0cb0-42d4-ab89-d7eec8a57485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.839309 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ad11-0cb0-42d4-ab89-d7eec8a57485 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.839589 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ad11-0cb0-42d4-ab89-d7eec8a57485 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.839865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ad11-0cb0-42d4-ab89-d7eec8a57485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:53.867779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3c31f-3cf1-482f-b91e-6b463e8073f3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:53.900606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:53.901386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.901661 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.901936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.908658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231ad11-0cb0-42d4-ab89-d7eec8a57485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.910134 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231ad11-0cb0-42d4-ab89-d7eec8a57485 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.910393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:53.911914 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-a2299ca5-5fb5-49ba-a329-bb709a7b2a09 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:23:53.926774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:53.928409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 259/499] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:53.930333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:53.931304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:53.946440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:53.947674 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:54.008532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.014610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 241/500] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:54.015985 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075eef1-56e6-4888-b2b4-5464542ad0e1 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.016275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075eef1-56e6-4888-b2b4-5464542ad0e1 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.016556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075eef1-56e6-4888-b2b4-5464542ad0e1 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.017979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 242/501] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:54.018507 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075eef1-56e6-4888-b2b4-5464542ad0e1 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.028702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 260/502] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:54.028702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.077482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.128751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075eef1-56e6-4888-b2b4-5464542ad0e1 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.129831 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9b384-147c-40e4-9064-a3e986078beb None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.163299 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.164164 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.164469 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.164757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.164874 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.165039 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.165138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.165357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.165795 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:54.166108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.166213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:54.166495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.167530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.167971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff170e1a-c48e-4d8e-85b4-8b60bb23ae59 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.175682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 243/503] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:54.176302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.189379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 261/504] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:54.190705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.191031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.191307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.208638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:54.209854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:54.258851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.276071 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 262/505] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:54.276889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.277208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f4bff-6aee-4138-bac8-0eb23833f00b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.296559 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.321681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.322479 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.322765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.323076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.333594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.335103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:54.353722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:54.354979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:54.356215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:54.356215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:54.356215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:54.356215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:54.356215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 244/506] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:54.356215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.380283 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d60e48-6971-4305-a8b8-7a4d913b0967 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.415772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.416587 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.416869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.417148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.427292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:54.435673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:54.436760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:54.437701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:54.441729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 263/507] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:54.442452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.459264 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5163426-abc7-4a56-8d1d-a2220534c54e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.487094 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.494203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.495032 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.495324 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.495602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.506320 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.508382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:54.526753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:54.527949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:54.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:54.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:54.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:54.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:54.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 245/508] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:54.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.544279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.546701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a178ab-c8a7-4555-9684-d6c2c9b7a411 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.582004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.582654 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.582971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.583274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.628152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7d1ae-7b7c-4e37-91e8-22df22d94b25 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.652327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.653814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.661597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.662369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.662654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.662968 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.674030 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.675521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:54.693185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:54.694375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:54.695442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:54.695442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:54.695442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:54.695442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:54.695442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 246/509] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:54.695762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.704318 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.762287 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 264/510] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:54.763174 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.763419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.798624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0d4f-c347-44fa-a997-c8dadb49e4e7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.832958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.833625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.834191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.834951 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:54.835805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.837147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.849267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 247/511] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:54.850107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.867390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dced7-6d89-421c-b707-2fc7be8296e9 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.901763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.902429 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.902720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.903031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.903781 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:54.904097 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.905482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.914085 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 265/512] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:54.915091 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:54.924963 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.948373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644d8e-5326-4375-962b-228dfa40fe56 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:54.973836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:54.983628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:54.984297 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:54.984584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:54.984866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:54.985598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:54.985913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:54.987338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:54.998733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 248/513] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:54.999555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.016646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8838e86-af7e-42b8-97b3-b926aaea6a21 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.050469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.051163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.051444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.051717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.052437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:55.052744 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.054658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.066227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 266/514] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:55.067477 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.110143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1522f-f61d-41d4-8505-c692d0ddd7da None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.132695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.144024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.144817 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.145099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.145389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.155773 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.157214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.167861 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5a9e-5bb9-4057-b751-6370fdea0f2e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:55.174466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:55.175585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:55.176583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:55.176583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:55.176583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:55.176583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:55.176583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 249/515] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:55.176583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.204801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.205528 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.205812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.206088 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.213387 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.214908 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.217590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:23:55.229432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:55.230479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:55.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 267/516] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:55.232205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.279882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cedfa-5d6d-47ea-ac41-90906fe37fff None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.313285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.314074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.314357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.314640 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.325281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.326734 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.332744 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e2be-72c9-47e3-bcac-5f4e1cbce8f0 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:55.343801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:55.344806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:55.345901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:55.345901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:55.345901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:55.345901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:55.345901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 250/517] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:55.345901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.363360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.373656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.374461 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.374748 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.375063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] PATH_INFO: `/v3/users/glance` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.384190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.385678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:23:55.400411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:55.401626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 268/518] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:55.402684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.442522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.456803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6319-e8cc-493f-80f0-df8a38ab9354 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.491210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.492395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.492680 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.492961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.493674 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.495152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.515508 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 251/519] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:23:55 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:23:55.516302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.526150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f89c1-feff-4c54-9a3d-3de2250d6c0e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.572521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.573281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.573574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.573860 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.574911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:55.575237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.576751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.595670 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 269/520] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:55.596943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.629125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0f39a-dcf4-4453-9df5-3007b0721360 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.656792 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.673587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.675060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.675459 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.675848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.676778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:55.677205 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.679953 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.701512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 252/521] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:55.702376 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.713948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.721115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fdb3d-833e-476d-9b21-01e251cf4598 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.765948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.767436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.768040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.768574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.770044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:55.770928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.773629 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.792073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 270/522] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:55.792933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.825082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279fc81-ebc6-4531-b1d7-a02ac83900a0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.867425 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.868108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.868393 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.868672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.869526 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:55.869838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.871430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.905115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f92ba-db90-4572-bb14-198ade92e228 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:55.914706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 253/523] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:55.914706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.915332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:55.942029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:55.942852 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:55.943138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:55.943414 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:55.951054 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:55.952513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:23:55.968086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:55.969309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:55.970739 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 271/524] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:55.974401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:55.989360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.033480 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e912e8-293d-4a41-86bd-a100be0f9219 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.073907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.074972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.075519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.075974 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.076975 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dc16b79859ae48a2a54a68666fc9dc1f) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:56.077578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.079360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.080873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d801c2-3f69-45a3-9f79-b04835dd6dbc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.086068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 254/525] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/role_assignments?user.id=dc16b79859ae48a2a54a68666fc9dc1f&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:56.087151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.133050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.133977 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.134268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.134548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.143611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.145112 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:23:56.161904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:56.163086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:23:56.165167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:56.168635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 272/526] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:56.169772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.201924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.243223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864446-ce6d-4ea2-940c-f4e21d0bfeb0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.285500 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.292594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb109-2615-4749-aff0-277e155cf4e8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.300943 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.302545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.302921 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.303207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.339031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.339704 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.339990 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.340329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.341168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:56.341486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.343270 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.362927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 273/527] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:56.363911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.380239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.381719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.460442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.487392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 255/528] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:56.487834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30ac72-a835-4895-9363-3a00fad9dc8e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.488142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.517578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.530139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.531193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.531798 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.532288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.533436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:56.534037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.535827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.557075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 274/529] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:56.558192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.597538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c4134-5861-46d3-ba46-cd40195eb401 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.634600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.635291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.635574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.635854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.637146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dbe4f5348f2948c893eba38d9aa68be4) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:56.637146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.638545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.646730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 256/530] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/role_assignments?user.id=dbe4f5348f2948c893eba38d9aa68be4&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:56.647376 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.676434 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d18a4-1dd3-4a32-b360-9cfe456d6100 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.736980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.739943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.742441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.743011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:56.765522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:56.767961 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:56.771369 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:56.790263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:56.791610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:56.792636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:56.792636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:56.792636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:56.792636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:56.795051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 275/531] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:56.804566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:56.837908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:56.862697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41179-a54a-4307-86d5-dc365bc76a4f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:56.923175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:56.923834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:56.924117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:56.924395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.006241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37ef28-ae34-4da9-8c54-378c16c392b5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:57.019795 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.021899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.068907 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:57.070175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:57.071903 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:57.073129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.074126 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:57.075171 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.077089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.103999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 276/532] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:57.108925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.192683 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:57.202066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:57.215320 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 257/533] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:23:57.220973 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.297233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deb2d1-ac97-4ded-8337-fd77348ed9fa None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:57.382881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971304-5add-4f5f-add5-a128b918e91a None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:57.383868 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:57.385080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:57.385328 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:57.385606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.399995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.401437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:23:57.427626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:57.428988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:57.430213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 277/534] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:57.432636 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:57.433492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:57.433849 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:57.434192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.444040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.448955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.451554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:57.489417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:57.490476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:57.491581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:57.491581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:57.491581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:57.491581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:57.491581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 258/535] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:57.496509 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.593854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:57.642586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e64bc1-8b59-4b46-b9bc-1dd69059fb09 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:57.653032 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c34ea-fdd7-4b6c-8ff3-87169d993a01 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:57.689133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:57.698664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:57.699388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:57.699676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:57.699955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.700711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:57.701025 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.702420 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.716132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 259/536] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:57.721414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.744530 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:57.745207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:57.745541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:57.745828 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.746625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:57.746968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.748683 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.776168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 278/537] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:57.782092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.828053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11a9a-aa28-4ce6-ad1f-46d699c29bf1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:57.830453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:57.864537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:57.865347 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:57.865636 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:57.865918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:57.883214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:57.884701 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:23:57.913949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:57.915132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:57.916131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 260/538] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:57.924837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:57.979115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ce62-8168-4e68-bfc3-264d5e0545e1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:58.019238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:58.019952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.020241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.020517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.021461 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=8b2bdb254541444a99a98b8d6e3fde4b) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:58.021783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:58.023846 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7646-8bcf-461e-aa5b-8b9a3c56670a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:58.031774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 279/539] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/role_assignments?user.id=8b2bdb254541444a99a98b8d6e3fde4b&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:58.033190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8e74-2c37-4d1f-b54f-eceea9661a50 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.033479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8e74-2c37-4d1f-b54f-eceea9661a50 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.033757 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8e74-2c37-4d1f-b54f-eceea9661a50 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.034363 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73014d1-6bef-411b-86a7-b0f1bfcb98de None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:58.040208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 280/540] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:58.042150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.042449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.042733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.071515 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:58.073002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:58.075349 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:58.076050 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.076337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.076623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.077444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:58.077759 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:58.079288 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:58.101621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 261/541] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:58.107900 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:58.130215 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:58.178021 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:58.216316 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 281/542] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:58.249802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:58.298201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81460769-6de5-49b7-a782-4216db1c6adc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:58.371460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:58.372481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.372994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.373804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.374042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00200b9b-9700-456b-968f-b74c3e7a203d None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:58.375117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=7d83f7f26aa442d197a1d3396357a6e5) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:58.375729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:58.377517 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:58.391821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 262/543] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:23:58 2022] GET /identity/v3/role_assignments?user.id=7d83f7f26aa442d197a1d3396357a6e5&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:58.430304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:58.431608 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.432136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.432628 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.451986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:58.461195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:58.462327 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:58.463304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:58.471790 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 282/544] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:58.477606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:58.590775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:58.604696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87467867-cf82-49a3-a66d-d48ad0f1316b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:58.649367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:58.649984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.650344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.650631 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.651446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:58.651760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:58.653173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef69882-dc73-4ec4-bc1c-c01bf0197b63 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:58.668441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 263/545] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:23:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:58.669813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:58.710644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:58.796584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2ad91-e5ec-4e7c-b586-af40f2f7cffc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:58.843438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:58.844246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.844535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.844815 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.862015 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:58.863566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:58.889194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:58.890236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:58.891263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:58.891263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:58.891263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:58.891263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:58.894594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 283/546] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:58.896214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c025e-e9f1-440b-9bf1-150235663562 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.896516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c025e-e9f1-440b-9bf1-150235663562 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.896799 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c025e-e9f1-440b-9bf1-150235663562 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.899473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 264/547] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:58.900555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:58.908411 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:58.908705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:58.908993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:58.935885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:58.937620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:59.049277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:59.068151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 265/548] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:23:59.087495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba79a1-7334-4c34-bfa2-672616a8b7c1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.093338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.161105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.163049 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.163383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.163678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.164472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:59.164793 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:59.166254 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:59.206321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 284/549] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:59.207317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.213715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:59.238878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d343-5cfb-4baf-a9eb-65fb8a3d4b65 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.279786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.281211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.281948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.282460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.293923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:59.302414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:59.304211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:59.305247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:59.308169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 266/550] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:59.314012 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.429012 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa4fee-43c3-4fca-81c5-fd0e6b8b9746 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.454766 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece593-3a24-4ded-b695-bfffed2458fb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.467768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.469067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.469582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.470133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.479616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:59.481530 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:59.493210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.493884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.494172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.494451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.495242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:59.495556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:59.496934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71aba-4dcb-47a1-bae7-4d9d26f8fd5e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d7101a11-aeab-4c72-91c6-f91ca04dae16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:23:59.499849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:59.500882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:23:59.501964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:59.504881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 285/551] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:23:59.506356 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb312-979b-4c26-a512-7e3ba54c9fc3 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.506934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb312-979b-4c26-a512-7e3ba54c9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.507445 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb312-979b-4c26-a512-7e3ba54c9fc3 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.509191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 286/552] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:23:59.514686 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 267/553] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:23:59.515781 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb312-979b-4c26-a512-7e3ba54c9fc3 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.516511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.516882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.517319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.519804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:59.523644 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:59.535842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:23:59.537147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:23:59.610273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 268/554] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:23:59.611704 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.636612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb312-979b-4c26-a512-7e3ba54c9fc3 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.674381 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.675403 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.675890 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.676448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.677583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:23:59.678090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:59.680469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:59.699361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 287/555] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:23:59.700469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.722247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcc66e-54d5-425c-b742-4ee251987c5c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.763949 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:59.770853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:23:59.771867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.773644 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.773928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.774205 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.793282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:23:59.797644 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:23:59.818065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d7282-3352-4f70-8504-665a977c5a0e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:23:59.823778 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:59.824791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:59.825811 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:23:59.825811 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:23:59.825811 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:23:59.825811 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:23:59.833281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 269/556] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:59.833281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.867011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.867817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.868101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.868375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:23:59.879503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:23:59.888010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:23:59.889074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 288/557] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:23:59.890780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:23:59.953447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8edb6-de93-41a7-ac4a-b1737eed9612 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:23:59.992970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:23:59.993642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:23:59.993933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:23:59.994246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.012490 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf82a3-e2f9-4f47-b286-ab582c45ec7a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.035771 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.052746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.054599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.055148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.055784 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.056869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:00.057415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.059072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.065573 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.079075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 289/558] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:00.080302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.086031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.087571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.194848 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032620b-19f3-4d49-8049-7e9bdf348f27 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.226493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 270/559] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:00.226493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.239196 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.240268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.240837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.241364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.242344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:00.242918 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.244699 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.255213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 290/560] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:00.257290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.321286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.331714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.353947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0e53-b8e4-4a97-9c22-9ba2ccdecc64 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.394546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.394956 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfda118-ef6a-40a1-a181-1b6e2a5a7433 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.395965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.396531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.397176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.409837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.411807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:00.432163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:00.433383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:00.434470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:00.437601 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 271/561] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:00.438812 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.446694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.447629 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.447995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.448349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.462867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.468563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:00.483227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:00.484423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:00.485810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:00.485810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:00.485810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:00.485810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:00.487037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 291/562] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:00.487744 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.563091 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99800f-b211-49ce-af43-1c8b8b988757 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.588976 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.595975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce2c3f-8e69-43f5-bf81-f369d7a394c7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.610001 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.611198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.611489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.611917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.623415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.624890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.627929 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.636935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.637681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.638032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.638379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.639321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:00.639703 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.641225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-de05c1d8-5d51-4680-9643-440c6fa10d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:00.644179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:00.645232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:00.646213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:00.646213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:00.646213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:00.646213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:00.646213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 272/563] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:00.646867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830328-4a51-4e1a-948e-d3dabeed9a22 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.647035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830328-4a51-4e1a-948e-d3dabeed9a22 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.647375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830328-4a51-4e1a-948e-d3dabeed9a22 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.653200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 273/564] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:00.653200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830328-4a51-4e1a-948e-d3dabeed9a22 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.667272 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 292/565] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:00.668427 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.783319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830328-4a51-4e1a-948e-d3dabeed9a22 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.796117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fb94-588c-484d-b28a-7a49604f7549 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:00.820203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.820894 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.821182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.821478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.822214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:00.822537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.824042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86276f45-41e7-4ced-b000-f890c488c05d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.836682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:00.837653 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.837801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 274/566] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:00.838913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:00.839128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.839415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.845708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:00.845708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:00.845708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:00.845708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:00.845708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:00.860551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 293/567] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:00.861747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.869787 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:00.871055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:00.879095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.927483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:00.947728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 275/568] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:00.948571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:00.978474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8067d3-cbd1-4a4f-8f2d-07622c3ca5bc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.013760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.014558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.014872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.015154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.026053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.027542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:01.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:01.046093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:01.047255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:01.047255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:01.047255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:01.047255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:01.047255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 294/569] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:01.047255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.068445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dee76-b323-4780-9c10-fa0ee1423f82 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.109956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.110768 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.111086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.111365 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.113772 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.118466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.119984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:01.134587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:01.135793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 276/570] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:01.137265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.157045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68a5b1-bece-4c22-93e0-10533ae2a6b1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.185974 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.191163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.191964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.192246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.192526 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.201057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.202512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-1caa8bd9-64dc-4bf3-bafc-aebcdc35dc2b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:01.217380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:01.218727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:01.220044 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 295/571] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:01.220728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a1ce-b7ea-4977-9c24-26b1d74d90ce None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.220728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a1ce-b7ea-4977-9c24-26b1d74d90ce None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.220890 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a1ce-b7ea-4977-9c24-26b1d74d90ce None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.222206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 296/572] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:01.222849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a1ce-b7ea-4977-9c24-26b1d74d90ce None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.245062 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eac70d-7584-4ed0-82e0-d4f85d7f1261 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.279664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.280457 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.280743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.281023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.291149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:01.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:01.300163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:01.301153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 277/573] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:01.303526 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.328566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a1ce-b7ea-4977-9c24-26b1d74d90ce None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.351582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.362571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.363261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.363548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.363827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.364550 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:01.364859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.366265 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.378000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 297/574] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:01.378816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.404973 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312126e3-7b85-4da0-a07b-6683d0dc763d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.411851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.447326 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.447999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.448283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.448560 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.450383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:01.450696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.452628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268fc6a-7b2f-4157-8204-f9c9254a4fe8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.477489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 278/575] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:01.477489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.477489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.477489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.493750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:01.494981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:01.501928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebfd9f-63e6-4601-901a-0347204a0cbc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.538726 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.539417 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.539706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.539987 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.540838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:01.541149 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.542734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.559629 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 298/576] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:01.560619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.564450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 279/577] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:01.565305 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.607232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.664070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6c52-408c-43c4-8bf5-1228af5712f9 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.669071 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.675296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d600-6039-48de-b2df-1940bcf7e366 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.698234 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.698940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.699230 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.699515 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.700281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:01.700595 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.701989 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.710722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.710911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 299/578] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:01.711314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.711413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.711620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.711867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.721495 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.722959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:01.737207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:01.738382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 280/579] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:01.744847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.816649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aba6a-178f-490d-80ec-e186b32b1570 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.819145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:01.847388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee112-2a9f-422d-8fad-4303a9d0e044 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:01.863677 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.864340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.864999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.865294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.867278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=435afe0dd8504af59c4b47f61a273bde) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:01.867600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.869059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.882839 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 300/580] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/role_assignments?user.id=435afe0dd8504af59c4b47f61a273bde&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:01.882839 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.892720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:01.893549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:01.893828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:01.894099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:01.906769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:01.908303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:01.927084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:01.928203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:01.929344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:01.929344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:01.929344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:01.929344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:01.929344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 281/581] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:01.929670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:01.942144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.000872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fd284-a4d7-4689-8d56-eb978490a4ed None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.037737 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.039484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.039767 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.040053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.048781 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f179cf-77a1-4140-a13a-c1262379b9f6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.051951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:02.060359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:02.061455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:02.062406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 301/582] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:02.063243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.087360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.088263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.088560 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.088842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.097629 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.099995 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.101545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:02.121317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:02.122815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:02.124114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:02.124114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:02.124114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:02.124114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:02.124114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 282/583] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:02.124817 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.179518 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731d25-f71d-46f0-9b9b-c2df90156e95 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.199332 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.225128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.225901 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.226265 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.226557 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.228209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:02.228583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.230510 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.247697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d74e92-a5ca-4987-b9e8-66cecdbc6721 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.252671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 302/584] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:02.253345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.284908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.285884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.286175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.286459 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.287257 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:02.287584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.288952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.302282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 283/585] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:02.303124 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.353781 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.369114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149456-9629-4f18-9550-c6cf921e38ba None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.407801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.408473 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.408661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73486b9-2041-47a2-b4bc-26023433a98c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.408782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.409018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.410052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:02.410363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.411790 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.420615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 303/586] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:02.421380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.435933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.451839 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.452733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.453287 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.453961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.454699 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:02.455051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.456433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.476179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 284/587] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:02.477182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.530077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5fa2b-4ad5-4742-9654-05dd173c8f1b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.569139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.570036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.570320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.570600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dc16b79859ae48a2a54a68666fc9dc1f/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.586324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=dc16b79859ae48a2a54a68666fc9dc1f, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.587828 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.590741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4462aa-09e9-44d9-87d8-d0ad4f304324 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.598408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.604514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 304/588] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:02 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dc16b79859ae48a2a54a68666fc9dc1f/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:02.616538 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.642971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.644175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.644638 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.645170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.655149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.657107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:02.675409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:02.676550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:02.677586 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:02.681455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 285/589] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:02.682859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.738647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.757649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a19ee-1ca8-4760-b8c5-c6d825cb722a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.811026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.811383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e890fb-515b-4946-86b7-9329f87fc990 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:02.812082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.812490 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.812871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.831206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.832915 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:02.855506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:02.856624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:02.857614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:02.857614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:02.857614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:02.857614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:02.858100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:02.859169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:02.859522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:02.859873 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:02.860680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 305/590] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:02.861884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.868902 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:02.870453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:02.887774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:02.888850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:24:02.889896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:02.892551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 286/591] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:02.893664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:02.923033 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:02.973204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e3335-ad7f-48ec-99e0-2f57e490deae None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.001066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.004923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a5bf-e740-4237-9c31-2329ffadfe2b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.011078 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.011837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.012237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.012605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.013486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:03.013866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.015638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.033892 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 306/592] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:03.033892 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.054571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.055723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.056223 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.056690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.057748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:03.058311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.059945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.078873 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 287/593] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:03.079959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.157449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4a89d-2359-4cf3-aa57-57e4e9874f26 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.172981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.195427 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa288-2580-49c6-af1b-f412f3770ff6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.198451 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.199168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.199457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.199740 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.200594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:03.200911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.202495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.227864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 307/594] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:03.228766 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.233365 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.234276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.234564 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.234867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dbe4f5348f2948c893eba38d9aa68be4/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.250908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=dbe4f5348f2948c893eba38d9aa68be4, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.252371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.269068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 288/595] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:03 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dbe4f5348f2948c893eba38d9aa68be4/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:03.270189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.288859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.360529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d16122-ac6a-497a-9a1a-320ddf5aba28 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.403474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.404713 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.405175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.405622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.414062 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42806cc5-f7ec-4831-8ef5-2accdb79d92d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.415189 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.417075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:03.434052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:03.435466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:24:03.436641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:03.443227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 308/596] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:03.445701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.453977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.454845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.455106 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.455401 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.483811 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.485709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.500275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:03.532089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:03.533202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:03.534307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:03.534307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:03.534307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:03.534307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:03.534307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 289/597] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:03.539143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.594676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0396-ac15-41cf-aa7d-151d78181e90 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.630159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.648237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.649069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.649485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.649924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.650956 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:03.651441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.653010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.675383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923007-44a5-4a75-8841-a8f72d60e9d4 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.675624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 309/598] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:03.680973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.720538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.721217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.721567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.721853 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.722619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:03.722955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.724327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.745033 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 290/599] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:03.750775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:03.839005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.864211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245189b3-efe8-4683-9948-21a7660ee8bb None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.900369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b188-c753-4473-8c14-b7a33c4b2b15 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:03.945868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.947191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.947595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.948003 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.957808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:03.963926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:03.965588 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:03.987957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:03.989783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:03.991790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:03.993025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:03.993943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:03.994329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:03.994709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:03.996545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 291/600] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:04.006997 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.007788 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.008727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:04.028332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:04.029584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:04.030833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:04.030833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:04.030833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:04.030833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:04.032337 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 310/601] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:04.037529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.165009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8d90-6103-4814-a329-eb47745d960f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:04.202767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:04.203488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.203999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.204354 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.205078 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9800b5-b80e-4aa2-ba69-dc3e5b0ca620 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:04.205302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:04.205687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.207405 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:04.220962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 292/602] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:04.227817 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.263289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:04.264010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.264280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.264511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.265253 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:04.265564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.266991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:04.281177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 311/603] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:04.282052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:04.291794 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.318544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:04.412287 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b200-883a-4c6e-ab3d-7cd5d5441bb2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:04.450533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:04.451508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.451854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.452138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.460425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.461854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:04.477271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:04.478512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:04.479646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:04.483053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 312/604] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:04.484471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.552283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c74b-4ed6-46e4-9be2-310b333f0642 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:04.554839 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:04.589476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51859ebc-fcb7-4c39-b0b0-5a9b61b271cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:04.590534 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859ebc-fcb7-4c39-b0b0-5a9b61b271cb None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.590974 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859ebc-fcb7-4c39-b0b0-5a9b61b271cb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.591382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859ebc-fcb7-4c39-b0b0-5a9b61b271cb None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/8b2bdb254541444a99a98b8d6e3fde4b/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.607391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a5b9-8b1e-4967-9dca-1c7419012f0b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:04.608550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51859ebc-fcb7-4c39-b0b0-5a9b61b271cb None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=8b2bdb254541444a99a98b8d6e3fde4b, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.610139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51859ebc-fcb7-4c39-b0b0-5a9b61b271cb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:04.626159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 293/605] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:04 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/8b2bdb254541444a99a98b8d6e3fde4b/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:04.627762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f4e39-7efa-46e9-b0d3-31279e857ed4 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.628164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f4e39-7efa-46e9-b0d3-31279e857ed4 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.628681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f4e39-7efa-46e9-b0d3-31279e857ed4 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.630130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 294/606] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:04.645346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.645667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.646094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.680064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:04.681864 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:04.683846 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:04.684642 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.684935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.685214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.686037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:04.686357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.689773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:04.716407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 313/607] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:04.723028 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.845145 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 295/608] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:04.873393 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:04.911907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:04.912252 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dbf7-e9c0-4299-90aa-236f6f8d374d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:04.937421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:04.953505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:04.954431 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:04.954714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:04.955916 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/7d83f7f26aa442d197a1d3396357a6e5/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:04.973887 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=7d83f7f26aa442d197a1d3396357a6e5, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:04.977158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:05.003166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 314/609] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:04 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/7d83f7f26aa442d197a1d3396357a6e5/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:05.020932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d05c6-4d1e-4c54-bb14-2c9c4b505372 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:05.061805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946d32f-bcb0-420f-9f52-b95b86d6340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:05.063247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946d32f-bcb0-420f-9f52-b95b86d6340f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.063792 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946d32f-bcb0-420f-9f52-b95b86d6340f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.064286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946d32f-bcb0-420f-9f52-b95b86d6340f None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.077344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946d32f-bcb0-420f-9f52-b95b86d6340f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-b946d32f-bcb0-420f-9f52-b95b86d6340f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:05.086027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:05.087313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:05.088492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:05.091242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 296/610] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:05.097485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.205663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c223-7088-4856-95f9-5f29c5c81a0e None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.206722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c223-7088-4856-95f9-5f29c5c81a0e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.207252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c223-7088-4856-95f9-5f29c5c81a0e None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.209181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 297/611] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:05.215819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.216458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.217007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.228647 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfd47-0397-45a5-899d-c2d82f038749 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:05.238481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:05.240030 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:05.266640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:05.267424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.267863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.268194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.269076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:05.269392 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:05.270811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:05.280920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 315/612] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:05.289696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.325540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:05.330665 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 298/613] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:24:05.359633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.382622 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:05.398532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3f689-22a2-437e-8525-c5c8be20f639 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:05.435042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:05.435851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.436137 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.436417 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.448108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:05.449579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:05.469132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:05.470183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:05.471320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:05.471320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:05.471320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:05.471320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:05.471320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 316/614] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:05.476326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.526843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb71ce-9b21-467b-87f6-1eec1fdbd486 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:05.594574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:05.596554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.597670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.597968 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.621075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:05.629196 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:05.645503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:05.646624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:05.648851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 299/615] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:05.652620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41880299-828f-460b-a5f9-6d8becce2121 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:05.653003 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.696020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:05.697102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.697935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.699211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.699989 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:05.700309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:05.701732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:05.736936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 317/616] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:05.742124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.779295 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:05.793510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa383ec2-53b9-43ba-8dbf-c9006e12f587 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:05.833360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:05.834454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:05.835022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:05.835537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:05.836887 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:05.837440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:05.839068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:05.849293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 300/617] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:05.857252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:05.975908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ed1a-88bf-4b42-95fc-139f43244825 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.006673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38515b2-e430-41aa-92ae-702fbd7885a9 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.013318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.014433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.014910 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.015341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.017435 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.029528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.031428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:06.051115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:06.052360 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:06.053604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:06.053604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:06.053604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:06.053604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:06.055693 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 301/618] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:06.061312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.064561 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.066605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.068100 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.068700 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.087700 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.089318 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-6c0f2c7a-2994-4ea8-94e9-b8f002deca89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:06.106021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:06.107383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:06.108563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:06.113435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 318/619] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:06.114882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b455c1-4c84-4c93-a9cb-05b82c090f35 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.115177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b455c1-4c84-4c93-a9cb-05b82c090f35 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.115460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b455c1-4c84-4c93-a9cb-05b82c090f35 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.117666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 319/620] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:06.118382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b455c1-4c84-4c93-a9cb-05b82c090f35 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.126770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.193362 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1685d7-272f-4137-a1a0-c0601178c2e7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.232241 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.233880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.234438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.234977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.235940 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:06.236593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.238016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b455c1-4c84-4c93-a9cb-05b82c090f35 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.238581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259a3dd-a7de-432c-9315-564af07dfa90 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.253494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 302/621] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:06.255257 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.255759 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.256915 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.275038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:06.276591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:06.281092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.281576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.281576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.281856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.282624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:06.283041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.284501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.308588 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 320/622] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:06.309434 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.326990 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.364901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 303/623] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:06.364901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.402842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.448547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a719be-7c79-4bef-91bc-800a26ad6c95 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.468981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3f01-6844-4ff5-844a-844b0754fe68 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.486470 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.487654 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.488223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.488715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.496706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.498896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.507007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.507844 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.508129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.508402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:06.515928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:06.516981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:06.518068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:06.519176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.520565 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 321/624] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:06.525682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.526885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:06.541927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:06.543067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:06.544096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:06.544096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:06.544096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:06.544096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:06.544096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 304/625] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:06.544403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.611280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.640727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf78a-3fc2-4717-bf81-22192d0cdd47 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.664775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4733d4-40b8-4a79-bd1e-ea4b01b7b758 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.666326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.680779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.681979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.682499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.683102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.695135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:06.703352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:06.704428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:06.705412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:06.706133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.706133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.706133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.706133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.706977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:06.707152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.708687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.714214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 322/626] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:06.715377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.733537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 305/627] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:06.733537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.826021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122205-78ac-4a0d-9240-96ad85636fca None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.839280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:06.843324 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089014-20b5-4289-884a-3fb85e14b5a0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:06.873026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.873734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.873979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.874256 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.875021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:06.875370 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.876737 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.886215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:06.887259 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:06.887762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:06.888276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:06.893568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:06.893727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 323/628] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:06.893727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.893892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:06.893892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:06.903648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 306/629] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:06.904939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:06.944156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.004681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04fb54-6663-499b-8b5a-7bc6efa9e594 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.017070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130722-67aa-489d-ba6c-df8a57988c36 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.041879 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.042541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.042859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.043142 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.056137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.057260 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.057761 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.058317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.066162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.068007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:07.083521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:07.085208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:07.086258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:07.093797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 307/630] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:07.095364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.111208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.126300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.127824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.178572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.211690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b85355-cca1-4481-9d34-19ccb56ff939 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.248980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.249761 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 324/631] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:07.250702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.251080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.251587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.252084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.264030 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.265837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:07.285323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:07.286369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:07.287960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:07.287960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:07.287960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:07.287960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:07.289544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 308/632] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:07.294094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.359086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.359578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7455-dda7-411e-9206-279e30766b73 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.401359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.402277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.403042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.403474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.404400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:07.404718 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.405371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a73213-3552-4bfc-b8ff-a19a20c536d9 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.406167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51d8d7-9d29-47a9-80e9-821abff4bc3e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.425309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 325/633] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:07.425309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d622-388c-4dc3-bc5c-9d0864019631 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.425309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d622-388c-4dc3-bc5c-9d0864019631 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.425309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d622-388c-4dc3-bc5c-9d0864019631 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.426192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 326/634] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:07.427222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858d622-388c-4dc3-bc5c-9d0864019631 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.429941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.445024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.445826 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.446111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.446392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.457023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.458473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:07.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:07.478468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:07.479639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:07.479639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:07.479639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:07.479639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:07.479639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 309/635] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:07.479639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.546298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858d622-388c-4dc3-bc5c-9d0864019631 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.586554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.587257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.587546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.587828 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.588562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:07.588881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.590292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff141c-c2fa-4f31-ae2a-e8d8859683d4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.595371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba368e2f-3fba-499a-ae0a-65b852c66501 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.606658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 327/636] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:07.606658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.606658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.606658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.614269 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.621648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:07.623134 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:07.638865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.639833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.640104 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.640336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/435afe0dd8504af59c4b47f61a273bde/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.657127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=435afe0dd8504af59c4b47f61a273bde, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.658798 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.673467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 310/637] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:07 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/435afe0dd8504af59c4b47f61a273bde/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:07.674644 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.686259 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.708173 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 328/638] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:07.708173 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.792473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2858f-a547-4486-8db7-6ce6c48d5032 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.826683 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff05c2-b355-4138-96ea-8c7cafe93c19 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:07.831448 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.832143 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.832428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.832708 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.833454 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:07.833762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.836294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19bbdf-7a53-4d33-9771-2fbf26726c89 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.858438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 311/639] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:07.858438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71add629-616c-4803-b876-f1e567d5e01f None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.858438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71add629-616c-4803-b876-f1e567d5e01f None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.858438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71add629-616c-4803-b876-f1e567d5e01f None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.858438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 312/640] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:07.860061 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71add629-616c-4803-b876-f1e567d5e01f None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.870976 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:07.871716 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:07.872005 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:07.872288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:07.880307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:07.882362 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:07.889571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:07.898042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:07.899294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 329/641] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:07.900660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:07.958105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:07.978258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71add629-616c-4803-b876-f1e567d5e01f None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.010498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc87816-6d0d-42fa-a27c-eeeb4fe7ca0a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.014510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f9af-cb1e-457f-81ba-1c283f8f0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.015553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f9af-cb1e-457f-81ba-1c283f8f0c4d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.016010 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f9af-cb1e-457f-81ba-1c283f8f0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.016462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f9af-cb1e-457f-81ba-1c283f8f0c4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.028080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85f9af-cb1e-457f-81ba-1c283f8f0c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-5b85f9af-cb1e-457f-81ba-1c283f8f0c4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:08.036750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:08.038647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 313/642] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:08.039715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.040603 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.040603 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.052501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.054091 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.054374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.054647 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.059098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:08.060366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:08.061758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.063294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:08.077371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:08.078400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:08.080136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 330/643] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:08.083701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.136647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 314/644] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:08.138068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.163967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.198306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83092-d5c0-4563-a0d7-ed25bc287f82 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.213307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.238999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.239701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.240036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.240249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.241626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:08.241940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.243537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.257173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5f91a-954b-419a-8fb2-803924bd77da None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.268468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 331/645] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:08.268468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.294387 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.295099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.295383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.295659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.296407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:08.296714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.298070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 315/646] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:08.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.379293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989430-1e08-4373-a491-330af9c67b3d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.386908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.415880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c466e2-f658-4123-bffc-808472d61699 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.416958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.417631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.417919 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.418223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.419027 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:08.419358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.420814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.433197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 332/647] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:08.433854 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.460325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.461369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.461842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.462393 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.468053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.476156 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:08.484741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:08.485994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:08.487175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:08.489338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 316/648] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:08.490304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.546292 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb71fd-a369-4c3c-8347-dcb3a1fbf329 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.582460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.583139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.583427 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.583928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.600627 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997efe5-a134-4c64-b63f-3e200be036b0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.637616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.638340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.638624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.638939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.641077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.653341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.656118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.669281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.671407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:08.681263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:08.682331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:08.683377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:08.683377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:08.683377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:08.683377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:08.683377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 317/649] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:08.683697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.707446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.790611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 333/650] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:08.790611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.796327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b012d2-73f2-4afc-8a00-dd1d9228cda7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.832509 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.833277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.833641 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.833928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.835367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dc16b79859ae48a2a54a68666fc9dc1f) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:08.835681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.837122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.844312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 318/651] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/role_assignments?user.id=dc16b79859ae48a2a54a68666fc9dc1f&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:08.845304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:08.914983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d24d2-c418-4f7d-a53c-98a6772e5741 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:08.932270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.956279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:08.962145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:08.962868 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:08.967243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:08.967243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:08.967243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:08.967243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:08.967243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:08.977262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 334/652] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:08.978270 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.020022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48418ad0-2f57-4296-b910-44829af4bf78 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.061957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.062982 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.063450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.063882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.064763 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:09.065242 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.066770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.080156 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 319/653] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:09.081994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.107674 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6bb97-d415-4ff0-9ee0-762159ac0f7e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.151208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.152267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.152267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.152548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.165692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.167156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:09.189209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:09.190480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:09.195855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:09.195855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:09.195855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:09.195855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:09.195855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 335/654] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:09.195855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.222279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36fa64-048d-4b86-a1f6-e4601d6e62c2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.235163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:09.246728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:09.262818 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.263638 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.263922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.264199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.276217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.277722 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:09.298114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:09.299395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:09.300605 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:09.300605 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:09.300605 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:09.300605 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:09.304485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 320/655] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:09.305329 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.310839 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0ff42-f125-4537-90c3-bcf2d46edbea None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.346828 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.347895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.348390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.348834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] PATH_INFO: `/v3/users/glance` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.360116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.361807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:09.378497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:09.380301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:24:09.382128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:09.384070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 336/656] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:09.385023 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.423200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31307c6e-d0b4-4003-b7af-20fbfbd9f7e3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.463214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.463940 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.464228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.464505 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.465239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:09.465548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.466962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.480120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 321/657] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:09.481080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.495929 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c645d6-7d89-4f06-95af-5d6ad9d97107 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.498975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:09.511013 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:09.539738 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.540414 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.540701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.540983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.541979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:09.542301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.544136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.564261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 337/658] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:09.564261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.610089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ccc5-8b1d-4639-8838-ef4c1252df8e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.654613 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.655327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.655613 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.655898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.657272 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:09.657600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.659406 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.676059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a10fc-a2a9-4e12-a668-e27ff40582b6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.686170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 322/659] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:09.686170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.718936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.720034 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.720471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.720898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.728541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.730259 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:09.746710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:09.748269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:09.749343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:09.751698 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 338/660] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:09.752952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.784245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:09.789406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:09.808146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33049c1-df35-4855-a7b7-ee4e9f19c09e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.846214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.847512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.847965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.848407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:09.859809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:09.861489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:09.882947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:09.884270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:24:09.885546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:09.893304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 323/661] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:09.893304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:09.900119 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938003-0c25-4507-b823-9d1dae830c4e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:09.936986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ec489-dde6-485f-a2be-b8a9c9d5c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:09.937911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ec489-dde6-485f-a2be-b8a9c9d5c249 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:09.938415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ec489-dde6-485f-a2be-b8a9c9d5c249 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:09.938924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ec489-dde6-485f-a2be-b8a9c9d5c249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.001893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147fdd3-6fee-4d9a-8e55-0c80a9715a98 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.016151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ec489-dde6-485f-a2be-b8a9c9d5c249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.017783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ec489-dde6-485f-a2be-b8a9c9d5c249 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.039769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.040697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.040984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.041265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.042063 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:10.042380 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.043831 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.044293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.053576 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.062580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 324/662] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:10.063683 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.130414 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 339/663] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:10.132013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d60eaa-185f-434d-b7fc-0413a1b97417 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.132406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d60eaa-185f-434d-b7fc-0413a1b97417 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.132786 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d60eaa-185f-434d-b7fc-0413a1b97417 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.138444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 340/664] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:10.138444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d60eaa-185f-434d-b7fc-0413a1b97417 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.179155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4504a-4b12-4869-834c-919dc2382092 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.215980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.216713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.217104 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.217487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.218442 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:10.218885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.220419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.239726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 325/665] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:10.241171 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.251720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d60eaa-185f-434d-b7fc-0413a1b97417 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.277820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.291195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.291855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.292144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.292425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.293261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dbe4f5348f2948c893eba38d9aa68be4) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:10.293582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.295064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fa53-da27-4e23-9299-091de0655524 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.308615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 341/666] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/role_assignments?user.id=dbe4f5348f2948c893eba38d9aa68be4&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:10.308615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.308615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.308615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.321130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.328182 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:10.329564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:10.373744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dfce0-5610-476e-a9a6-c33a63ad4ecf None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.409830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 342/667] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:10.411620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.414192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.422827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.422827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.422827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.444887 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.446398 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:10.473544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:10.474595 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:10.475717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:10.475717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:10.475717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:10.475717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:10.478913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 326/668] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:10.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.543157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51025b8-006c-402e-94a1-36654b0ed10a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.565487 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.590851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.591507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.591797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.592081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.608139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750dd9-99a8-4c10-ae0b-30a3a13e184b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.625422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.655807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.657213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.657508 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.657793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.669012 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.670681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.670963 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:10.681101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:10.682350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:10.683343 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 327/669] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:10.684132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.791306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 343/670] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:10.792183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.799479 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aef5e-e631-408f-999c-c58b4869090d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.813020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.841256 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.842332 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.843031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.847912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.848959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:10.849517 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.851801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.867311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 328/671] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:10.868478 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.902108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:10.904850 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38eac8-14ff-49a2-8265-9ef62d769702 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:10.941590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:10.942268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:10.942553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:10.942874 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:10.944189 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:10.944549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:10.945958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:10.960248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 344/672] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:10.960931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:10.986111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eccf92-5bc3-4554-95c2-e2bdb3f0478b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.027800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.028987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.029536 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.030038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.041827 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.043669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.047101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:11.065971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:11.067089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:11.068095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:11.068095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:11.068095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:11.068095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:11.068376 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5a358-e6a3-4bff-8417-2dde165efa10 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.071351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 329/673] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:11.072376 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.111325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.112153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.112536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.112692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.121552 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.123132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:11.139065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:11.140160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:11.141151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:11.145020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 345/674] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:11.146309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.179495 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.202645 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0937-e4eb-4c81-9a2b-b2b4478ae46d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.244365 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.245673 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.246282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.246770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.252323 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1720747-b2f2-42c9-805c-a95127f211d0 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.259549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.261487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:11.281896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:11.282998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:11.283992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:11.283992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:11.283992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:11.283992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:11.286294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 330/675] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:11.287897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.295245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.296056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.296340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.296619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.297361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:11.297676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.299380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.309257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.314939 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 346/676] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:11.316984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.409414 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30c78e-7916-4be5-9848-5a32a7702391 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.431713 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b64c-bcd9-48e4-b6b2-b9cf65776f02 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.445652 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.446322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.446623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.446944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.447715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:11.448025 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.449437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480ca63-5458-47ca-a2d8-47f36d3c96b8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.451064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.463024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 331/677] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:11.464257 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1b8b0-dd3c-4361-92ad-5f461a41c91e None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.464555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1b8b0-dd3c-4361-92ad-5f461a41c91e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.464836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1b8b0-dd3c-4361-92ad-5f461a41c91e None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.470058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 332/678] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:11.470058 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1b8b0-dd3c-4361-92ad-5f461a41c91e None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.477224 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.478158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.478558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.478980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.479783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:11.480168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.481550 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.501116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 347/679] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:11.501116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.566827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.579950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1b8b0-dd3c-4361-92ad-5f461a41c91e None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.616693 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c234b-cd91-4579-9618-6c2f39d4c7fc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.622072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.623541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.623541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.623541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.638362 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.639852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-42f5378c-e700-497c-bc7f-24e6799a50ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:11.654934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:11.655958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 333/680] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:11.657677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.658310 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.658310 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.664458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.665209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.666240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.666240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.666619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=8b2bdb254541444a99a98b8d6e3fde4b) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:11.666964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.668413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.683016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 348/681] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/role_assignments?user.id=8b2bdb254541444a99a98b8d6e3fde4b&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:11.683016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.684129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:11.685637 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:11.748070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.778525 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 334/682] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:11.779862 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.812638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3586-a10e-4a97-9486-38355bc5dd4b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.847025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:11.864101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.865582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.866357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.866890 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.880414 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.882856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:11.904219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:11.905365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:11.906430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:11.913103 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 349/683] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:11.913103 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:11.926206 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a7dc4-e15c-4628-84f6-fac2bd518ac8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:11.968252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:11.971245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:11.971540 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:11.971828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:11.972634 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:11.972952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:11.974396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:11.989776 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 335/684] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:11.990998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.039599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67965-fd87-41a5-bd78-7b537d9800c5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.052639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:12.082086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.082931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.083527 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.083811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.095087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:12.103804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:12.104862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 350/685] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:12.106240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.126616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c62f9-1e2d-41ae-8660-1adaa1641106 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.157381 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:12.172256 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.173129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.173395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.173718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.174731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:12.175034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:12.176482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:12.196249 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 336/686] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:24:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:12.197191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.224499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce12fa-cf31-438f-a8dc-8428a4a77f7e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.264728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.265882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.266415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.267023 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.268108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=7d83f7f26aa442d197a1d3396357a6e5) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:12.268642 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:12.270452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:12.283035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 351/687] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/role_assignments?user.id=7d83f7f26aa442d197a1d3396357a6e5&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:12.284463 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.307701 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b837d9-ee67-4e6c-87b2-ba9fb9f41491 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.309996 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:12.348244 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.348936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.349312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.349513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.350870 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:12.351191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:12.352573 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:12.362172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 337/688] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:12.367702 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.508201 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326a1cc-cc23-4add-ad33-621e24d8e5e4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.511919 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74eb54-7aa6-4645-9910-5f96e0f397d4 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.528830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:12.560708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ec46a-032e-4b94-bb07-73accdd3e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.561559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec46a-032e-4b94-bb07-73accdd3e326 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.561856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec46a-032e-4b94-bb07-73accdd3e326 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.562142 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec46a-032e-4b94-bb07-73accdd3e326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.582471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.583330 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.585263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.585263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.599205 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:12.601545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:12.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:12.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:12.624658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:12.624658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:12.624658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:12.624658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:12.624658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 338/689] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:12.628834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.653984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:12.668778 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ec46a-032e-4b94-bb07-73accdd3e326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:12.671333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ec46a-032e-4b94-bb07-73accdd3e326 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:12.765511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88aeaa-f15b-4714-b3f1-3d38326bb4fc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.797114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 352/690] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:12.799406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a5ed-8a0d-49d0-a3b3-4d44300b7c06 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.799406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a5ed-8a0d-49d0-a3b3-4d44300b7c06 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.799406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a5ed-8a0d-49d0-a3b3-4d44300b7c06 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.801686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 353/691] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:12.804586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a5ed-8a0d-49d0-a3b3-4d44300b7c06 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.817456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:12.823669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:12.824945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.825419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.826115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.827081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:12.827739 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:12.829574 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db0ecc-7c3d-4715-ae43-dde489e6799d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:12.851537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 339/692] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:12.853099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:12.853499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:12.853979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:12.873404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:12.874762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:12.944678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a5ed-8a0d-49d0-a3b3-4d44300b7c06 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:12.962875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 340/693] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:12.963890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:12.976894 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.003426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.004944 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.005664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.006687 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.021230 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.024057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:13.049797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:13.051058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:13.052312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:13.052312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:13.052312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:13.052312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:13.054478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 354/694] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:13.055536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.101548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e00c04-fdcc-4d61-b136-0077369311c2 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.123986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.150138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.151364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.151882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.152469 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.161395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.163647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.168922 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39ee43-8029-4a5e-996e-6afb78f19359 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:13.179805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:13.180911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:13.181999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:13.185045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 341/695] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:24:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:13.186072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.215392 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.216586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.217106 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.217598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.218964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.221095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:13.241336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:13.242513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:13.243590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:13.247109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 355/696] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:13.248418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.287814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.327986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82365290-1b15-40d6-af36-75d1573878fd None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.370313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.371056 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.371599 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.371892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.372897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:13.373215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.374838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.383262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d496c-2d3d-4c42-b661-9409b74d21e0 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.390049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 342/697] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:13.391254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.415072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.419405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.420086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.420375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.420659 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.421790 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:13.421927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.423693 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.448496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 356/698] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:13.449229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.527340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5b8b3-403e-4f58-81f8-0776da824dcb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.555903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.565467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd9e00-3f4b-4518-b6da-a48b5c044780 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.567372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.568432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.568432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.569341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.569975 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:13.570397 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.572046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.581997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 343/699] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:13.581997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.624251 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.625885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.626411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.627311 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.636877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.639017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:13.657047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:13.658087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 357/700] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:13.659539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.710325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.720262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179523b-a921-4fe3-8424-aff44e64d545 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.773336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.775042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.775556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.776095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.776897 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087ab3-5851-4fab-81d6-e26310431234 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.818359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:13.820006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:13.820513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:13.821001 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:13.821982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:13.822639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.825112 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.832785 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 358/701] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:13.833873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:13.871869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:13.898495 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:13.900040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:13.964620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ff0c-0875-4091-bf6f-82f8510e6fdc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:13.983205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:14.007883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.008924 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.009423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.010270 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.011489 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:14.012145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.014013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.030115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 359/702] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:14.038855 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.165525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca06fc-9adf-4cf7-9a8b-84fcd40e7747 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:14.178690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 344/703] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:24:14.184953 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.210322 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.211395 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.211759 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.212112 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.213042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=435afe0dd8504af59c4b47f61a273bde) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:14.213421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.215597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbf9d1-ec4f-4207-baba-ed891b0a8490 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.224498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 360/704] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/role_assignments?user.id=435afe0dd8504af59c4b47f61a273bde&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:14.288262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f6175-6c5e-4d03-a3be-448d48a282d0 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.288706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f6175-6c5e-4d03-a3be-448d48a282d0 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.289100 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f6175-6c5e-4d03-a3be-448d48a282d0 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.290962 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 361/705] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:14.296556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.296952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.297345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.301801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:14.313609 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65158-73b7-4d96-ab37-4f4570e9d18d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:14.316702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:14.318040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:14.354249 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.355151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.355440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.355727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.359243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:14.367227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.368787 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:14.388685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:14.389918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:14.391193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:14.391193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:14.391193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:14.391193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:14.391193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 345/706] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:14.395924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.398291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 362/707] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:24:14.424863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.537286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da79d-2fd4-4dd0-813d-4c36a88ee829 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:14.588277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.589980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.590510 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.591106 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.592095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:14.592494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69430c-92c6-4d71-bcb7-2d0c7d45880d None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:14.593278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.594940 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.608301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 346/708] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:14.615282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.621452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:14.647498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.648326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.648624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.648909 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.663396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.664895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:14.686622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:14.687708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:14.688802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:14.688802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:14.688802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:14.688802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:14.688802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 363/709] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:14.694026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.709456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:14.770209 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be5c07-6077-4cb3-ae92-bf5487924f09 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:14.808179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.808992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.809279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.809561 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.817347 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.819465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.834584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f960f-52bc-4f49-9a7f-22189f3ff2b1 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:14.836616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:14.837628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:14.838695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 347/710] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:14.843678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.879760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:14.881489 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:14.882034 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:14.882547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:14.883564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:14.884116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:14.885777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:14.899790 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 364/711] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:14.907622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:14.923903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:14.967698 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48376847-24ab-4c87-8735-5419da9c346f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:15.013034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:15.013664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.013951 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.014166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:15.014281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.015072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:15.015572 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:15.016806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00d42-fbb5-4663-94c8-8d4963a70d86 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:15.036700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 348/712] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:15.039300 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603570b2-8af5-481c-8e2e-277922935543 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.039825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603570b2-8af5-481c-8e2e-277922935543 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.040603 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603570b2-8af5-481c-8e2e-277922935543 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.043122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 349/713] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:15.044099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603570b2-8af5-481c-8e2e-277922935543 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:15.056325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c956593-f3b3-4678-8381-a699d9c46cff None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:15.093677 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3154ac3-5efa-4d7d-b453-c589c6794da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:15.094355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3154ac3-5efa-4d7d-b453-c589c6794da3 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.094638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3154ac3-5efa-4d7d-b453-c589c6794da3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.094967 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3154ac3-5efa-4d7d-b453-c589c6794da3 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.095688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3154ac3-5efa-4d7d-b453-c589c6794da3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:15.097715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3154ac3-5efa-4d7d-b453-c589c6794da3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:15.124695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 365/714] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:24:14 2022] POST /identity/v3/users => generated 254 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:15.126729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.127824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.128348 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.152257 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:15.154993 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:15.176710 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603570b2-8af5-481c-8e2e-277922935543 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:15.202821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:15.219012 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:15.219841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.220179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.220543 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.221627 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dc16b79859ae48a2a54a68666fc9dc1f) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:15.222125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:15.223932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:15.234992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 350/715] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:15 2022] GET /identity/v3/role_assignments?user.id=dc16b79859ae48a2a54a68666fc9dc1f&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:15.261117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 366/716] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:15.300181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:15.441587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db604-f675-4c27-8149-d831c8a3e15e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:15.485810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:15.486560 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.486877 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.487163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] PATH_INFO: `/v3/services/network` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.487838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:15.489237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:15.505408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:15.506691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:15.508322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 351/717] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:15 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:15.512814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:15.600540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:15.657204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963bd0-39bf-4626-9954-c35c9d92ff66 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:15.707305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:15.708384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.709522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.710030 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.710997 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] RBAC: Adding query filter params (name=network) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:15.711552 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:15.713177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135051d-d506-47f2-8970-bb8556195027 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:15.718375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 367/718] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:15.723794 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:15.789431 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:15.846494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abd929-f5ce-4580-af15-871d22885ea6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:15.907018 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:15.908092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:15.908615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:15.909115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:15.910153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] RBAC: Adding query filter params (type=network) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:15.910695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:15.912377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eb987-383d-45ed-be99-6bc8b0121dfe None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:15.923497 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 352/719] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:16.660860 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f4b4-b67b-4adc-8f30-143548d451a0 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:16.661981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f4b4-b67b-4adc-8f30-143548d451a0 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:16.662493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f4b4-b67b-4adc-8f30-143548d451a0 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:16.664400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 368/720] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:16.669559 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b5c9-3ecf-4782-abb0-0d0b0d4a7f9a None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:16.670162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b5c9-3ecf-4782-abb0-0d0b0d4a7f9a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:16.670685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b5c9-3ecf-4782-abb0-0d0b0d4a7f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:16.696854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-ebf0b5c9-3ecf-4782-abb0-0d0b0d4a7f9a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:16.698438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ebf0b5c9-3ecf-4782-abb0-0d0b0d4a7f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:16.790208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 353/721] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:16.825508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f4b4-b67b-4adc-8f30-143548d451a0 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:16.975229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f4b4-b67b-4adc-8f30-143548d451a0 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:17.010408 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:17.029041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f0e0b-82cf-45b7-b64d-b0c2f8250dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:17.029727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0e0b-82cf-45b7-b64d-b0c2f8250dad None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:17.030016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0e0b-82cf-45b7-b64d-b0c2f8250dad None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:17.030307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0e0b-82cf-45b7-b64d-b0c2f8250dad None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:17.031156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f0e0b-82cf-45b7-b64d-b0c2f8250dad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:17.032631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f0e0b-82cf-45b7-b64d-b0c2f8250dad None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:17.071561 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 369/722] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:16 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:17.594306 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf4c3-2307-4d99-89bb-95fb0ba8c1a0 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:17.594721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf4c3-2307-4d99-89bb-95fb0ba8c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:17.594958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf4c3-2307-4d99-89bb-95fb0ba8c1a0 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:17.596488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 354/723] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:17.602289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:17.602585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:17.602909 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:17.621713 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:17.623224 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:17.716116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 370/724] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:17.743939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf4c3-2307-4d99-89bb-95fb0ba8c1a0 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:17.824335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:17.922963 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf4c3-2307-4d99-89bb-95fb0ba8c1a0 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:17.968080 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201657ea-51ed-45e5-855a-ab1fedab2685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:17.968888 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201657ea-51ed-45e5-855a-ab1fedab2685 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:17.969172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201657ea-51ed-45e5-855a-ab1fedab2685 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:17.969449 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201657ea-51ed-45e5-855a-ab1fedab2685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:17.987765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201657ea-51ed-45e5-855a-ab1fedab2685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-201657ea-51ed-45e5-855a-ab1fedab2685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:17.996568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:17.998005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:17.998988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 355/725] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:18.004430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.068793 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dae859-3184-4aa4-9a4f-1f516528ec20 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.069170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dae859-3184-4aa4-9a4f-1f516528ec20 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.069464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dae859-3184-4aa4-9a4f-1f516528ec20 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.071196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 356/726] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:18.076600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0c5c7-f38a-445e-ae51-844b494eed3b None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.076889 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0c5c7-f38a-445e-ae51-844b494eed3b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.077175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0c5c7-f38a-445e-ae51-844b494eed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.110940 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-2ea0c5c7-f38a-445e-ae51-844b494eed3b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:18.112074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-2ea0c5c7-f38a-445e-ae51-844b494eed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:18.189871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4c41d-8360-4e3f-8f3b-51ee9b9b47f6 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.215158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:18.241102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:18.242147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.242674 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.243235 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.244317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:18.244894 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:18.246519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776ef0-1b4a-448a-aed6-8dc2dbf100a2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:18.258081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 357/727] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:24:18.260462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337a6bf-a07a-4e48-a406-3e7a9ff79405 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.260762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337a6bf-a07a-4e48-a406-3e7a9ff79405 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.261050 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337a6bf-a07a-4e48-a406-3e7a9ff79405 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.261831 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 371/728] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:18.263828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 358/729] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:18.269445 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.270016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.270560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.273185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337a6bf-a07a-4e48-a406-3e7a9ff79405 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.312611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:18.314302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:18.335799 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:18.424279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337a6bf-a07a-4e48-a406-3e7a9ff79405 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.455306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 372/730] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:18.457520 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.493274 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:18.494089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.494374 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.494924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.506703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:18.508228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:18.543181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:18.544268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:18.545296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:18.545296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:18.545296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:18.545296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:18.553799 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 359/731] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:18.554824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.585862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:18.591050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489c615-f7ac-4fad-98eb-5df1f1604920 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.630634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:18.634304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.634605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.634923 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.663841 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:18.672246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:18.673317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:18.674277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 373/732] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:18.675140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.720533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:18.747755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cea28-e24c-4937-ae5a-6634cf6f13a2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.800039 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:18.801416 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.801950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.803096 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.805306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea88d-cc78-4947-98cf-4b3e7db3d146 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.815489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:18.824730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:18.826190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:18.827187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:18.830203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 360/733] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:18.831368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.842748 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:18.843458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.843798 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.844081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.844884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:18.845207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:18.846723 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:18.862695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 374/734] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:18.863585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:18.888231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:18.949047 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212833a0-f51a-4125-a182-dfba6587b184 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.973045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903ffe-25a0-413d-8537-1359a0618479 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:18.984714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:18.985100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:18.985389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:18.985671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:18.986430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:18.986743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:18.988138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.002733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 361/735] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:19.002733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.012933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.018673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.019441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.019737 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.020018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.020786 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:19.021129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.023209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876062-bdde-489b-a54a-f43ceda7aaa9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.036377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 375/736] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:19.038290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faee24c-198f-48b6-bc63-3857bb82fbbc None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.038589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faee24c-198f-48b6-bc63-3857bb82fbbc None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.038897 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faee24c-198f-48b6-bc63-3857bb82fbbc None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.040329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 376/737] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:19.044853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faee24c-198f-48b6-bc63-3857bb82fbbc None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.111608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44985e-5097-4e79-a6e7-55b169d40e92 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.132421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.150324 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.151157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.151446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.151726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.153670 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faee24c-198f-48b6-bc63-3857bb82fbbc None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.159815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.161265 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:19.175606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:19.176700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 362/738] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:19.178578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.194273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.195273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.195933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.196275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.207447 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.209477 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-1438dd90-8b59-4e8e-ad47-2e4f8f3855d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:19.226821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:19.227825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:19.228905 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:19.228905 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:19.228905 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:19.228905 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:19.228905 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 377/739] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:19.229773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.229773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.229962 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.248636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:19.249843 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:19.258753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.297149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860971b-2803-4192-8de9-80244f723fa1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.337737 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.338506 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.338861 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.339097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.352981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.354490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:19.374735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:19.375859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:19.382089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:19.382089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:19.382089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:19.382089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:19.382089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 363/740] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:19.382089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.455821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 378/741] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:24:19.457072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.505539 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82daea8-f697-4220-81fd-ad5ca0d64af6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.525818 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.529622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.544127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd23009-f945-4293-a049-9afab059119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.545301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd23009-f945-4293-a049-9afab059119f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.545629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd23009-f945-4293-a049-9afab059119f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.545847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd23009-f945-4293-a049-9afab059119f None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.547184 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd23009-f945-4293-a049-9afab059119f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:19.547498 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd23009-f945-4293-a049-9afab059119f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.549253 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd23009-f945-4293-a049-9afab059119f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.568304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 364/742] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:19.569122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd23009-f945-4293-a049-9afab059119f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.570638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca398f-0e30-4be4-ac8f-34c22fcb57e7 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.612863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.614042 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.614540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.615082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.616218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:19.616863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.618340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.635303 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 379/743] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:19.635303 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.675452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd23009-f945-4293-a049-9afab059119f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.716127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.716841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.717127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.717408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.718159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:19.718473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.719921 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.739155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 365/744] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:19.739155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.749627 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c140b-faab-4827-bb3d-ae678f1a6d61 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.774606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.781257 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:19.788132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.788799 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.789082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.789357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.790083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.791483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:19.805282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 380/745] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:19 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:19.806058 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:19.881048 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91599-5a01-4457-8c82-303f9e082697 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.932144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442064-3b9f-4083-881e-5be09b703e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.932823 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442064-3b9f-4083-881e-5be09b703e67 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.933100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442064-3b9f-4083-881e-5be09b703e67 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.933375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442064-3b9f-4083-881e-5be09b703e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.946503 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b581e-c074-4992-aa7f-d7a32f8dd0f9 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:19.985439 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:19.986255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:19.986543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:19.986876 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:19.995020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:19.996482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:20.011657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:20.012754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 381/746] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:20.013871 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.016083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55442064-3b9f-4083-881e-5be09b703e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.018079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55442064-3b9f-4083-881e-5be09b703e67 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.055979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.063374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.121773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124302-8ea1-4ea8-850e-6fb0043aa990 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.136905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 366/747] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:24:20.136905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ec48-097e-4f33-9be9-b369a688df5d None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.136905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ec48-097e-4f33-9be9-b369a688df5d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.136905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ec48-097e-4f33-9be9-b369a688df5d None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.136905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 367/748] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:20.137411 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2ec48-097e-4f33-9be9-b369a688df5d None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.164862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.165673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.165956 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.166232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.174409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.175904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:20.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:20.192481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 382/749] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:20.194128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.269060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2ec48-097e-4f33-9be9-b369a688df5d None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.296842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc510bbf-bacc-4f49-b7f4-e1b47f2b326d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.300090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.308909 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.309524 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.309984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.310101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.311009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:20.311325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.312878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50137f84-56da-467f-9444-54cb13bb2c72 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.314739 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.335118 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.339922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 368/750] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:20.340063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.340063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.340063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.340353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.340353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.340353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.352175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.353651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.359362 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:20.360554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:20.371505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:20.372777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:20.373827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:20.373827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:20.373827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:20.373827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:20.373827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 383/751] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:20.373827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.436624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 369/752] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:20.437445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.506483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8959f2-61aa-4b63-96ba-bbebb6a5a3c6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.545689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.547093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.547595 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.548156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.548684 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1d20c-0ded-436a-9d4c-a36a28c65a98 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.549500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:20.550118 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.551911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.573074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 384/753] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:20.573842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.575988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.591449 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.592253 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.592531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.592803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.593442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.603847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.605301 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:20.623992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:20.625035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:20.626069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:20.626069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:20.626069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:20.626069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:20.626069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 370/754] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:20.626069 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.692499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44574-55c4-4bf0-93c2-fbbefa7dc0e5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.730166 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.732605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.732605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.732605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.732605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:20.732605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.733761 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.743032 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873072a4-52ed-4916-bf99-3c24dd788f1d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.747559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 385/755] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:20.748687 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.779885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.780986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.781487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.782020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.782913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.784580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:20.798501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:20.799747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:20.800885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:20.803856 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 371/756] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:20.804783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.833725 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.856536 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:20.868238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e14a3-33ff-4c37-b079-074927c6d1b6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.904934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.905584 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.905867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.906165 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.922492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc9008-575e-47cd-9f9a-639ea49081b6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:20.956566 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:20.957254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:20.957539 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:20.957822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:20.959335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:20.959735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.961166 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:20.974934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 372/757] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:20.979348 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:20.979833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:20.980816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.063622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.083250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.087500 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1f02-6dbe-4026-86fc-f5f92329d568 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.093582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 386/758] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:24:21.094435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.131483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.132541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.132857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.133963 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.142399 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.144432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:21.163419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:21.164418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 373/759] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:21.166072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.205709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a06999-bc14-4307-a438-f10263a5f227 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.242079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.242751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.243082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.243366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.244084 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.244415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.245789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.250707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 387/760] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.251527 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.282825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac933d-4a69-4251-bc70-d43ef6d8c49f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.296684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.320754 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.321548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.321831 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.322119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.329067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.330516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:21.345450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:21.346466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 374/761] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:21.347924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.368127 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.373062 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042209e-f350-4c49-85bf-b58b210846cb None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.408707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.409500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.409793 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.410074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.421116 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.422586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:21.440644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:21.441652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:21.442666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:21.442666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:21.442666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:21.442666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:21.442666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 388/762] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:21.442666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.464736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbf2c-8437-4852-a18a-cf22678224e6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.501462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.502133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.502421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.502703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.503537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.504103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.505275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.523724 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 375/763] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.523724 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.547059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.557618 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d9f73-f5a6-40d7-8b89-7ad68b405535 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.593279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.593951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.594241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.594534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.595300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.595663 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.597003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.602749 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 389/764] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.608210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.609472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.635409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26664e-8a0e-4d4b-b025-c7886909d161 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.677161 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.678383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.678662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.678965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.679763 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.680073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.681499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.695394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 376/765] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.696606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.718333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f396a-687f-489d-a66c-cc78ea8aa7fa None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.754804 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.756109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.756393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.756696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.757430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.757735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.759140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.774943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 390/766] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.774943 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.795043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.821341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041cb71-dc98-4baa-b66e-6f730c31c777 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.864105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.865319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.865606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.865886 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.866725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=435afe0dd8504af59c4b47f61a273bde) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.867074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.868545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.882815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 377/767] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/role_assignments?user.id=435afe0dd8504af59c4b47f61a273bde&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.882815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:21.886238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:21.897057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600f509-294f-4b33-938c-22fa463f91c4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:21.941436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:21.942232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:21.942611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:21.943553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:21.944513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] RBAC: Adding query filter params (interface=public, service_id=9c05fdf0fecd4ab3a06642ad0c1e9edb, region_id=RegionOne) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:21.944902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:21.946422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:21.961120 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 391/768] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/endpoints?service_id=9c05fdf0fecd4ab3a06642ad0c1e9edb&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:21.962234 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.038179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86144c4c-5896-4755-8d71-ba90ef62f359 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.063778 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:22.091043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e72f-4f42-4ea8-bf44-d5c2b6c26999 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.091719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.092626 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.092948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.093235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dc16b79859ae48a2a54a68666fc9dc1f/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.095254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=dc16b79859ae48a2a54a68666fc9dc1f, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.096710 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.115102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 378/769] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:21 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dc16b79859ae48a2a54a68666fc9dc1f/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:22.116194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.129953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.131471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.131760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.132036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.140652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.142268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2ff2c198-c447-4fb1-8db4-d7311210a3d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:22.159955 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:22.161041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:22.162096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 392/770] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:22.166836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbcb1e-c7ea-4b60-81c7-e640e1845a5f None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.166836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbcb1e-c7ea-4b60-81c7-e640e1845a5f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.166836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbcb1e-c7ea-4b60-81c7-e640e1845a5f None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.166836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 393/771] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:22.167234 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbcb1e-c7ea-4b60-81c7-e640e1845a5f None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.206227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:22.266217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bac0c-5743-4c74-85d1-51f9c6071741 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.299180 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbcb1e-c7ea-4b60-81c7-e640e1845a5f None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.312278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f1a3c-795f-43c3-b04e-6e44f5c26455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.313394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f1a3c-795f-43c3-b04e-6e44f5c26455 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.313873 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f1a3c-795f-43c3-b04e-6e44f5c26455 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.314339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f1a3c-795f-43c3-b04e-6e44f5c26455 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.315298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f1a3c-795f-43c3-b04e-6e44f5c26455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.316989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f1a3c-795f-43c3-b04e-6e44f5c26455 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.324376 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 379/772] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:22 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:22.326087 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.327002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.327483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.348121 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:22.349855 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:22.352080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.352856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.353219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.353577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.354473 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:22.354811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.356297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.364773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:22.371678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 394/773] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:22.378267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.435275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 380/774] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:22.460616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.522120 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97243b5-375e-4a88-9452-f8a595a915d6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.571327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:22.586672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.587806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.588160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.588508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.589432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=5c2b4134112f44839cf3194ccddc1ec8) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:22.589826 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.591424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.597867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 395/775] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:22 2022] GET /identity/v3/role_assignments?user.id=5c2b4134112f44839cf3194ccddc1ec8&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:22.622820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93564f1d-2948-4fe8-a2b6-8eb8641e1abc None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.662345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.663619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.664103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.664572 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] PATH_INFO: `/v3/services/network` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.665453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.667122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:22.681246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:22.682440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:22.683462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:22.686266 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 381/776] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:22 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:22.693573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.772991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:22.827864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240375d-4cc1-4309-951c-7560f841d51c None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:22.876968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:22.877566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:22.877853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:22.878132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:22.878889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] RBAC: Adding query filter params (name=network) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:22.879206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:22.881156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:22.886138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 396/777] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:22.891784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:22.997696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e780-61dd-494e-803e-34fa6961fc9f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:23.018581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:23.039703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:23.041125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:23.041627 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:23.042091 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:23.043030 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] RBAC: Adding query filter params (type=network) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:23.043528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:23.045082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:23.055616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 382/778] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:23.061543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:23.207614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5193b-f6d5-45e1-a8f6-599a83026b76 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:23.236039 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:23.245965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:23.246682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:23.247263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:23.247545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:23.248349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] RBAC: Adding query filter params (interface=public, service_id=e7ef160d60004d26a3377d2ee1799822, region_id=RegionOne) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:23.248662 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:23.250050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ec4ed-c002-41e0-af3b-7f505ae587c0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:23.256991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 397/779] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:23 2022] GET /identity/v3/endpoints?service_id=e7ef160d60004d26a3377d2ee1799822&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:23.263886 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:23.402601 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbe6af-a268-4e4f-8366-b0ac68225309 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:23.437757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f19bb-a3d2-482e-b114-c57d90131970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:23.438490 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f19bb-a3d2-482e-b114-c57d90131970 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:23.438781 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f19bb-a3d2-482e-b114-c57d90131970 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:23.439098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f19bb-a3d2-482e-b114-c57d90131970 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:23.439930 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f19bb-a3d2-482e-b114-c57d90131970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:23.441371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f19bb-a3d2-482e-b114-c57d90131970 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:23.447267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 383/780] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:23 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:24.705386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be875c-49b1-4cda-b02b-9f9019dd405e None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:24.706115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be875c-49b1-4cda-b02b-9f9019dd405e None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:24.706115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be875c-49b1-4cda-b02b-9f9019dd405e None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:24.707620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 398/781] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:24.713281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:24.713869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:24.713869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:24.743790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:24.744982 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:24.798727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:24.833159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 384/782] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:24.882218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be875c-49b1-4cda-b02b-9f9019dd405e None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.023647 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be875c-49b1-4cda-b02b-9f9019dd405e None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.077022 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758200a3-0aff-40c9-b24d-b86893c8766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.077820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758200a3-0aff-40c9-b24d-b86893c8766a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.078101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758200a3-0aff-40c9-b24d-b86893c8766a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.078374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758200a3-0aff-40c9-b24d-b86893c8766a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.098039 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758200a3-0aff-40c9-b24d-b86893c8766a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-758200a3-0aff-40c9-b24d-b86893c8766a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:25.106994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:25.108148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:25.109568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 399/783] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:25.117422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.231428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d6b69-3ea0-449e-bcc3-61354406884e None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.241217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d128ca-3610-4c0d-8235-c9fd3d950039 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.241819 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d128ca-3610-4c0d-8235-c9fd3d950039 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.242325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d128ca-3610-4c0d-8235-c9fd3d950039 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.245378 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 400/784] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:25.250004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.250585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.251138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.268186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.268869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.269149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.269422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.270179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:25.270506 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:25.272424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:25.272781 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5f8cd-ee5b-4779-8b4e-fd44282e808b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:25.274282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:25.285148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 385/785] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:25.285148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe115-3ec9-464a-9590-247b365cff89 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.285148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe115-3ec9-464a-9590-247b365cff89 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.285148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe115-3ec9-464a-9590-247b365cff89 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.285148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 386/786] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:25.290417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e771a3-352b-4241-934c-d4e3069d4fb1 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.290710 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e771a3-352b-4241-934c-d4e3069d4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.291041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e771a3-352b-4241-934c-d4e3069d4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.308430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-19e771a3-352b-4241-934c-d4e3069d4fb1 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:25.309862 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-19e771a3-352b-4241-934c-d4e3069d4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:25.334732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:25.352335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:25.362295 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 401/787] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:25.363671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.393033 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 387/788] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:25.394585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557cb13-f3b7-41da-84c6-236a7264cf46 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.395004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557cb13-f3b7-41da-84c6-236a7264cf46 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.395392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557cb13-f3b7-41da-84c6-236a7264cf46 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.401579 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 388/789] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:25.402624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557cb13-f3b7-41da-84c6-236a7264cf46 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.490151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf35da-66c7-44d1-aa77-78ab518c20b2 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.514179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557cb13-f3b7-41da-84c6-236a7264cf46 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.526137 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.526908 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.527232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.527502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.538733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:25.540231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:25.550581 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.551475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.551787 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.552710 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.553371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:25.554764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-b59f4db5-32a9-4dff-98d6-62d9fbe8b177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:25.559482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:25.560498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 402/790] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.566350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:25.567339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:25.569078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:25.570170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 389/791] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:25.572078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.587982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:25.589181 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:25.611775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:25.618467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:25.667599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 403/792] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:25.668350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.700359 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fece50-f1e9-4253-906f-25148fd25edc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.742800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.743616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.743896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.744172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.755642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:25.763231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:25.764280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 390/793] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:25.765255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.777464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da82eaa-c540-4dc9-bff4-cfae7257bace None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.815269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.815942 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.816231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.816511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.817249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:25.817574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:25.819617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:25.836089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 404/794] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:25.836089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.863603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:25.886247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:25.893626 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e6d51-26b6-49a4-bfdb-930458ee35c8 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.931980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.932654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.932948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.933317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:25.934041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:25.934350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:25.935744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:25.945582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 391/795] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:25.945582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:25.952393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80ddd-f20b-42ce-a94d-370f8ffe5705 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:25.993265 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:25.994078 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:25.994367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:25.994651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.005566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:26.013621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:26.014896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 405/796] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:26.015882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.055736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9eb9f-4dcd-444a-9b6c-02c103a2519c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.093118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.094100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.094100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.094372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.095176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:26.095493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.096916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.107919 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 392/797] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:26.113281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.113433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.136428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434edaa-c529-478d-aeb3-56ef046a5ba7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.139600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.173335 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.174135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.174424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.174708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.182660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.184168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:26.198926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:26.199965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 406/798] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:26.201020 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.232355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ecfa-aef0-498f-b54c-75e672407221 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.271882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.272555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.272844 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.273116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.274179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:26.274179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.275547 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.280537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 393/799] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:26.281323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.310285 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73996d0-0ae6-483f-b7f6-00ba151fe8d2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.343228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.343895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.344186 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.344474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.345230 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:26.345544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.346959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.355496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 407/800] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:26.356290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.359675 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.367733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.385427 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5064-7309-44ae-b457-e7cd1d6e9b38 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.420327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.421834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.422118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.422397 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.437231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.438684 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-2614cd4e-dfe6-4f07-9158-b8da4ed85c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:26.455531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:26.456590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:26.457618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:26.457618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:26.457618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:26.457618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:26.457618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 394/801] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:26.458967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36467f8-5f76-45b7-aed6-b733332b3c39 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.459130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36467f8-5f76-45b7-aed6-b733332b3c39 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.459413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36467f8-5f76-45b7-aed6-b733332b3c39 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.460670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 395/802] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:26.461351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36467f8-5f76-45b7-aed6-b733332b3c39 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.465891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963b82-2f35-48d6-bd06-11b68ef8b490 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.500371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.501038 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.501323 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.501601 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.502432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:26.502741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.504223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.521833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 408/803] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:26.522641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.569986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36467f8-5f76-45b7-aed6-b733332b3c39 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.583797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.604029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.604757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.605049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.605341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.606094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.607491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.611898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.624941 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c9dee-51e2-448b-afc5-92f154508d62 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.628221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 396/804] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:26.629126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.669400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.670222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.670508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.670812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.682758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.684291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-97741644-c805-4ae7-b980-f64cdd4ea000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:26.708245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:26.709368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:26.710396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:26.710396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:26.710396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:26.710396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:26.710396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 409/805] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:26.711195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.711195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.711400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.729840 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:26.731112 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:26.770385 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd31e2-a866-472b-9132-d392c3def721 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.817453 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 410/806] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:26.818948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.820250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.820880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.821171 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.821452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.822195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:26.822568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.824010 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:26.850118 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 397/807] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:26.851043 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:26.875553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.913036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:26.937561 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1107e-556b-4d6d-9324-bdad27276ba9 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.965647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d2cd-b02e-4f92-998c-b251efe690a0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:26.972364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960abc7-75f3-4889-b306-176020818246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:26.973444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960abc7-75f3-4889-b306-176020818246 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:26.973757 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960abc7-75f3-4889-b306-176020818246 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:26.974567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960abc7-75f3-4889-b306-176020818246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:26.984749 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960abc7-75f3-4889-b306-176020818246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:26.986241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960abc7-75f3-4889-b306-176020818246 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-3960abc7-75f3-4889-b306-176020818246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:27.004625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:27.006446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:27.007721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:27.007721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:27.007721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:27.007721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:27.008353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.008353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.008353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.008353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.008980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:27.008980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.009271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.012543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 411/808] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:27.013405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960abc7-75f3-4889-b306-176020818246 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.021546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 398/809] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:27.026692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.118968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.130934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960abc7-75f3-4889-b306-176020818246 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.168980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.169810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.170100 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.170385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] PATH_INFO: `/v3/services/network` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.171096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.172547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:27.186289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:27.190743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:27.192013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 412/810] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:27.193702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.263179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fac47a-abb9-4c6b-8805-d860b7a3818c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.276554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.298415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.299246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.299551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.299820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.301671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314080d-c031-4109-91b0-44667457e5bf None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.307767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.309212 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:27.323989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:27.325176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 399/811] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:27.326771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.342951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.343623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.343915 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.344199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.344934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:27.345246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.346636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.365346 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 413/812] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:27.365346 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.380893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.438727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f03dd-492e-48e0-a3dc-6cbadfc646ef None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.472365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56518e0-fbd9-40ad-b273-a4bfcac39e17 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.473918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.474739 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.475070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.475350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.483053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.484493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:27.499813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:27.500926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 400/813] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:27.502028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.517556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.518310 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.518677 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.518995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.519710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] RBAC: Adding query filter params (name=network) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:27.520017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.521984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.526912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 414/814] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:27.531666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.539683 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.616574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.617274 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248791d-7a4a-42d2-a8f7-60adcaf75236 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.637765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6783-4187-4f3b-8232-2e2271e6a797 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.655655 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.656614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.656904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.657185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.658024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:27.658337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.660222 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.674126 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.674986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.675273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.675549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.681582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 401/815] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:27.683002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.683241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.684845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:27.707982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:27.709615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 415/816] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:27.716018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.791474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.802540 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842626e3-1876-4b9f-a314-fbacb409fcb4 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.829151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bb0f4-e44e-448a-a59f-da2f91d02c37 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:27.840010 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.840701 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.841410 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.841695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.842549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:27.842875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.844337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.865637 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 402/817] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:27.866496 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.877208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:27.877876 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:27.878161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:27.878438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:27.879196 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] RBAC: Adding query filter params (type=network) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:27.879507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:27.882390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:27.890899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 416/818] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:27.890899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:27.895006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:27.982245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f289-cdde-40bd-97ab-ec472827e451 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.002445 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b54a0-0535-4561-9a24-c21205cbcb9e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.018602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.019285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.019568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.019849 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.038212 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.044294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.045223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.045722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.046184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.047210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:28.047706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.049355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.062864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 417/819] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:28.063866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.095709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.097207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.131568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.173036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d573887-fc91-435f-962c-2e9758c2ec31 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.198745 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 403/820] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:24:28.199579 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.213818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.214640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.214967 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.215246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.226747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.228278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:28.247537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:28.248568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:28.249575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:28.249575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:28.249575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:28.249575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:28.249575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 418/821] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:28.249575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.257540 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.312169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bf77-6f90-4c3f-bea6-2429a9d3f5a7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.350545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.351241 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.351526 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.351889 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.352541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.353897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.360004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939b7b-0db4-415a-838c-b65813274cd2 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.379106 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.383004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 404/822] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:28.385580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.409314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.410391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.410860 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.411893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/435afe0dd8504af59c4b47f61a273bde/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.414455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=435afe0dd8504af59c4b47f61a273bde, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.416313 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.437183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 419/823] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:28 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/435afe0dd8504af59c4b47f61a273bde/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:28.438242 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.544147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d693-3998-477c-bb66-31593ac15bb1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.553667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.588951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ed73-59d1-4ddf-ab92-6edff27013d4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.628857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.630051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.630485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.631137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.641864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.648849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.649555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.650038 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.651063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:28.651619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.653332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.663428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.665320 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.678692 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 420/824] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:28.685331 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:28.687700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:28.688720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:28.689728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:28.689728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:28.689728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:28.689728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:28.691731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 405/825] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:28.697422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.726552 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.832700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8eab-0d76-43fa-83e3-d07f88cb8fe7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.843410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd05e8-01e6-45e7-a8d7-66cffbf0ee38 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:28.880862 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.881692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.882174 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.882448 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.883334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:28.883743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.885195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.891633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:28.892684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:28.893142 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:28.893578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:28.902833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 406/826] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:28.907075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:28.907534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:28.909226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:28.924721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:28.925755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:28.926807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:28.927566 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:28.934183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 421/827] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:28.935809 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.028132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1576b4-7730-46b3-97e5-b9ce7d3a798a None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.037377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:29.046666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd001c4-3316-449a-ba45-f80aced031cf None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.065062 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.065868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.066151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.066428 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.074466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.076000 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.085070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.085733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.086014 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.086289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.087105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:29.087415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.088848 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a133e-f0a6-4aac-9993-bb184feaa1e1 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-cab58049-a6bd-446e-83cc-569527e19d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:29.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:29.091629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:29.092650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 407/828] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:29.093226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3339e-f408-433c-afcd-1c847bc1a129 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.093226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3339e-f408-433c-afcd-1c847bc1a129 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.094182 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3339e-f408-433c-afcd-1c847bc1a129 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.094899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 408/829] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:29.100168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3339e-f408-433c-afcd-1c847bc1a129 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.107381 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 422/830] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:29.110345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.110910 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.111446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.130465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:29.131683 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:29.188375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:29.202838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 423/831] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:29.202838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.222296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3339e-f408-433c-afcd-1c847bc1a129 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.257570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.258238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.258521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.258826 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.259618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:29.259928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.261349 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.273530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 409/832] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:29.274335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.297992 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:29.319026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993acd72-d570-4256-81d8-d62e4e09bbc0 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.355226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.356119 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.356404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.356681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/5c2b4134112f44839cf3194ccddc1ec8/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.372747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=5c2b4134112f44839cf3194ccddc1ec8, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.374220 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.379639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e4c5-3e35-4f9b-93f3-a17f0697b48c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.388733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 424/833] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:29 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/5c2b4134112f44839cf3194ccddc1ec8/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:24:29.389623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.436667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.437970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.438505 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.439041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.440760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.442971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.447363 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:29.462413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:29.463803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:29.464757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:29.467939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 410/834] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:29.474398 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.524646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5bbf0-33bd-4955-955c-1c7e89be6e66 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.563332 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:29.572117 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.573348 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.574011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.574506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.575625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dc16b79859ae48a2a54a68666fc9dc1f) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:29.576219 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.578197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.586870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 425/835] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:29 2022] GET /identity/v3/role_assignments?user.id=dc16b79859ae48a2a54a68666fc9dc1f&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:29.589202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054d0a-ac77-4e6f-94a3-541a58eae40b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.629444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.630714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.631034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.631312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.632038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:29.632348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.633849 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca9eea-77a0-4306-af93-178f5103aa6b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.639854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 411/836] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:29.645628 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:29.763233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3068087-d04a-4d15-b41c-7f5fe3a71cad None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:29.803451 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:29.804334 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:29.804624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:29.804979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:29.805712 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:29.806025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:29.807706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfa9ce-a2d2-4234-ba05-35b63687d753 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:29.813167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 426/837] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:30.883699 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8584f-2ff5-478f-9034-26f2a3c210ce None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:30.884285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8584f-2ff5-478f-9034-26f2a3c210ce None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:30.884285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8584f-2ff5-478f-9034-26f2a3c210ce None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:30.885946 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 412/838] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:30.891486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:30.891933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:30.892032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:30.910109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:30.911978 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:30.972763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:30.990920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 427/839] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:31.009660 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8584f-2ff5-478f-9034-26f2a3c210ce None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.079939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:31.123148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8584f-2ff5-478f-9034-26f2a3c210ce None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:31.158957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:31.159760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.160049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.160333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.172251 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:31.179959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:31.181092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:24:31.182151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:31.186099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 413/840] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:31.187513 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.292204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c8df6-5a14-45e4-bd89-ebaf4dcefbec None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:31.328204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:31.328887 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.329178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.329459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.330223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:31.330537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:31.331972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:31.346051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 428/841] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:31.347453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.466373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c01f-e03b-4f57-86bc-fbee20607807 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:31.493954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:31.507780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:31.508641 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.508930 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.509251 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.520403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:31.521865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:31.540207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:31.541275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:31.542286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:31.542286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:31.542286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:31.542286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:31.546120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 414/842] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:31.547560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.611180 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:31.662841 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565461-e581-4208-bad2-c92be87ecf75 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:31.699461 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:31.700191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.700480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.700763 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.701500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:31.701812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:31.703320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa9d4-b54b-4631-829a-326cb3ef9be8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:31.721085 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 429/843] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:31.722648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.757143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf501-5687-4ab8-969b-750e543dad81 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.757436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf501-5687-4ab8-969b-750e543dad81 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.757933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf501-5687-4ab8-969b-750e543dad81 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.760192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 430/844] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:31.766455 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.766859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.767070 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.793236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:31.794604 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:31.870111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d6703-35a1-45ce-b975-fb012ef901aa None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:31.891749 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 431/845] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:31.914614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:31.916100 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.916354 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:31.916841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:31.917323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:31.929906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:31.932278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:31.952436 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:31.953590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:24:31.954689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:31.962369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 415/846] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:31.964218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:31.973980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.011814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.040234 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553fd2b-ed4a-471d-837b-22034d8e7139 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.077971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47600-61c0-4bb4-80db-5ef49d179d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.079095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47600-61c0-4bb4-80db-5ef49d179d25 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.079385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47600-61c0-4bb4-80db-5ef49d179d25 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.079668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47600-61c0-4bb4-80db-5ef49d179d25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.088462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350da3-ac1b-437c-ba43-ea2449124a73 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.093902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a47600-61c0-4bb4-80db-5ef49d179d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-35a47600-61c0-4bb4-80db-5ef49d179d25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:32.102286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:32.103512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:32.104476 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 432/847] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:32.105293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202dd37-b8d0-4721-b319-bc2669fcae56 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.105293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202dd37-b8d0-4721-b319-bc2669fcae56 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.105441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202dd37-b8d0-4721-b319-bc2669fcae56 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.106857 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 433/848] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:32.111746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202dd37-b8d0-4721-b319-bc2669fcae56 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.144592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.145308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.146159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.146445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.148481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:32.148481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.149074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e162a1-f4f3-4dee-a8fc-a64c478db41f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.168675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 416/849] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:24:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:32.170094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504257-3779-4e4e-bd69-53f8a4fbba12 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.170395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504257-3779-4e4e-bd69-53f8a4fbba12 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.170682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504257-3779-4e4e-bd69-53f8a4fbba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.186812 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-22504257-3779-4e4e-bd69-53f8a4fbba12 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:32.188021 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-22504257-3779-4e4e-bd69-53f8a4fbba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:32.225963 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202dd37-b8d0-4721-b319-bc2669fcae56 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.227435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.256633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 417/850] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:32.257963 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7119006-b230-4da6-9179-b306ca23176a None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.258255 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7119006-b230-4da6-9179-b306ca23176a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.258534 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7119006-b230-4da6-9179-b306ca23176a None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.259852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 418/851] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:32.260527 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7119006-b230-4da6-9179-b306ca23176a None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.270382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.271100 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.271384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.271661 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.272430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:32.272734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.274131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735495b8-be89-46a4-b993-0e26819f1477 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.283279 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 434/852] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:32.284376 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.284668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.284949 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.291191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.300820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:32.302528 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:32.367503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7119006-b230-4da6-9179-b306ca23176a None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.368420 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 435/853] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:32.369245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.410034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.410690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.411042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.411323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.481157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.482522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.483800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.490988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443feefd-33b6-4ff1-9f10-7571b921980e None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.506973 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.526190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.527043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.527329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.527606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.528264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.529676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:32.542695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:32.543966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:32.544948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 436/854] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:32.545930 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.591881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 419/855] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:24:32.591881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.644227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c956ef-ecec-4aeb-92cf-0425ebc90c2f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.677667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.678463 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.678754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.679065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.687001 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7c01-52b3-4f56-aa71-1394165e8be4 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.689575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.691077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:32.709029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:32.710148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:32.711209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:32.711209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:32.711209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:32.711209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:32.711471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.716146 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 437/856] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:32.716146 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.722847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.723553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.723923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.724208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.724936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.726720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.728966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:32.742226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 420/857] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:32 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:32.742830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.844960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e624a-b92b-4b45-bd6a-fdeb63b300fd None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.878152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116d10-958f-46eb-ad54-c234f55bba9c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:32.894167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.894920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.895193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.895528 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.896294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:32.896606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.898150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.903971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 438/858] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:32.903971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.922896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:32.923723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:32.924015 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:32.924303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:32.937073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:32.938535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:32.956235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:32.957535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:32.960422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:32.960422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:32.960422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:32.960422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:32.960422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 421/859] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:32.960422 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:32.999278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.002960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.031575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d750eab-683a-4634-9bb6-28269734839f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.072295 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.072973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.073261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.073542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.073847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03cf04-6f07-4279-906e-4d0316a568fb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.074335 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:33.074652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.076077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.094157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 439/860] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:33.094157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.112079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.112990 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.113465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.113746 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.140098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:33.140098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.140098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.140098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 422/861] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:33.140098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.258880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28557d6-840b-4846-b831-169219496cf3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.290294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.297487 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.298179 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.298465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.298746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.299521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:33.299833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.300213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1256ed-5e77-498b-bd98-a6fd976e71a7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.301270 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.303768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.322666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 440/862] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:33.324153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.352887 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.353728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.354001 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.354279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.367220 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.368178 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:33.386597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:33.387616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:33.388453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 423/863] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:33.394633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.458952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e97d-bb11-48a2-87c3-cbd99cc52e05 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.498718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80722-a217-4218-9d39-a232e1b398c3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.502668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.503703 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.504131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.504546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.515126 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.517825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.542125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.542125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.542125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.542431 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.543401 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:33.543639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:33.544438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:33.545248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:33.545725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.546813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.552132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 441/864] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:33.553244 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.576383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 424/865] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:33.578210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.597840 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.615403 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.661660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312693-c15a-4f56-89db-cc397ae77278 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.685501 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6916-87ff-411b-9eaa-23be310862e9 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.697568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.698440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.698886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.699300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.700318 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:33.700808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.702427 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.720668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 442/866] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:33.722007 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:33.725124 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.725904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.726291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.726681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.799644 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.801137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.816252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.833480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0297c-cdcf-40c1-a4b2-9b94c646de13 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:33.878551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:33.879902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:33.880431 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:33.880880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:33.881867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=435afe0dd8504af59c4b47f61a273bde) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:33.882352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:33.884036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:33.890947 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 443/867] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/role_assignments?user.id=435afe0dd8504af59c4b47f61a273bde&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:33.891242 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:33.924923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 425/868] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:24:33.930912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:34.052684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdbb52-740a-40b8-8313-6816fd6f648f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:34.096505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:34.097719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:34.098237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:34.099353 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:34.111136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:34.112611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:34.131884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:34.132686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:34.133426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:34.133426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:34.133426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:34.133426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:34.133426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 444/869] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:34.139662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:34.245346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c8302-9ba2-4756-8d65-b04505945969 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:34.261170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:34.282897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:34.283567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:34.283846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:34.284119 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:34.284842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:34.285145 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:34.286817 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:34.298803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 426/870] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:34.304827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:34.338750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:34.421646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b812-cc35-46c2-8718-7b23262c7865 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:34.459887 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:34.460694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:34.460982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:34.461269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:34.468767 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:34.470266 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:34.484776 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:34.485546 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:34.486280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:34.486639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 445/871] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:34.493790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:34.602476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f03e-84c8-4872-8595-a171d2c2e983 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:34.638755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:34.639797 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:34.640297 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:34.640771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:34.641759 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:34.642267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:34.643984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2bfd4-753c-461f-819a-926fa6d4d3a6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:34.657829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 427/872] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:34.664638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:34.765210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:34.775382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2373df-7204-4697-a9d1-47e8dfaa1f4e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:34.811674 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:34.812345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:34.812635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:34.812918 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:34.813765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=5c2b4134112f44839cf3194ccddc1ec8) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:34.814084 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:34.815580 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cad0c-c01f-4bc5-b6d1-da36d3823d99 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:34.822387 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 446/873] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:34 2022] GET /identity/v3/role_assignments?user.id=5c2b4134112f44839cf3194ccddc1ec8&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:35.132452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0921-4194-4189-b2aa-4c17522851d3 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.132966 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0921-4194-4189-b2aa-4c17522851d3 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.133038 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0921-4194-4189-b2aa-4c17522851d3 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.134767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 428/874] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:35.140509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.141000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.141095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.159940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:35.161709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:35.242752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 447/875] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:35.261068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b0921-4194-4189-b2aa-4c17522851d3 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:35.297962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:35.375353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b0921-4194-4189-b2aa-4c17522851d3 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:35.412170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221062f7-431c-4886-90e9-8980439a734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:35.412895 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221062f7-431c-4886-90e9-8980439a734d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.413186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221062f7-431c-4886-90e9-8980439a734d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.413465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221062f7-431c-4886-90e9-8980439a734d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.414130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221062f7-431c-4886-90e9-8980439a734d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:35.415521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221062f7-431c-4886-90e9-8980439a734d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-221062f7-431c-4886-90e9-8980439a734d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:35.427656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:35.428515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:35.429216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:35.433815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 429/876] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:35.435199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:35.517695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ae2-25c2-4996-92ba-2e3df8fa7061 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.517987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ae2-25c2-4996-92ba-2e3df8fa7061 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.518269 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ae2-25c2-4996-92ba-2e3df8fa7061 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.519962 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 430/877] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:35.528564 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.528974 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.529366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.533275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:35.554337 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbc1dd-3f64-4d2d-9a3e-1986d4eb23f3 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:35.555076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:35.557464 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:35.594534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:35.595490 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.595889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.596276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.597122 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:35.597628 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:35.599839 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:35.610059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 448/878] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:35.611446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:35.639720 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 431/879] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:35.667432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:35.698401 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:35.736400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6fd5a-226a-4a68-b2c1-8b2c68bfee2c None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:35.775381 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:35.776156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.776449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.776733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.777555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:35.777870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:35.779299 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:35.780258 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a52e-4a27-4b50-a8d6-79cdd920b583 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:35.789555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 449/880] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:35.791067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:35.807086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:35.822043 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:35.822732 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.823047 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.823329 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.824085 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:35.825470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:35.850943 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 432/881] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:35 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:24:35.924881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc821b2c-f540-4c61-8b1b-c8639478664d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:35.978264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:35.978969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:35.979260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:35.979540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:35.980407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] RBAC: Adding query filter params (interface=public, service_id=4455ec87c0dd44f0bfce811f3129c9b9, region_id=RegionOne) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:35.980733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:35.982217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524b2c-a4dc-4ae5-b88c-64d7de0579d0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:35.992346 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 450/882] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:35 2022] GET /identity/v3/endpoints?service_id=4455ec87c0dd44f0bfce811f3129c9b9&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:35.994633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:36.096991 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:36.113885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8b5c3-1555-4d40-881e-f1c05bc654a0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:36.153086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2a710-5800-4fd5-8c30-18805340d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:36.153861 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a710-5800-4fd5-8c30-18805340d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:36.154075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a710-5800-4fd5-8c30-18805340d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:36.154358 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a710-5800-4fd5-8c30-18805340d9d8 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:36.155103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a710-5800-4fd5-8c30-18805340d9d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:36.156521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a710-5800-4fd5-8c30-18805340d9d8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:36.164088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 433/883] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:35 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:24:36.299761 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed90d9-b2a0-4a6d-b1fc-96bb2697698c None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:36.300288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed90d9-b2a0-4a6d-b1fc-96bb2697698c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:36.300288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed90d9-b2a0-4a6d-b1fc-96bb2697698c None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:36.302678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 451/884] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:36.308545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:36.308841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:36.309125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:36.330908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:36.332493 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:36.405820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 434/885] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:36.429153 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed90d9-b2a0-4a6d-b1fc-96bb2697698c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:36.505684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:36.539616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed90d9-b2a0-4a6d-b1fc-96bb2697698c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:36.576672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:36.577698 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:36.578132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:36.578559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:36.579398 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:36.581013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:36.594517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:36.595672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:36.596622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:36.599067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 452/886] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:36.608181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:36.698279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:36.719000 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03771702-4610-463e-a245-afe8d4b400f4 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:36.756764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:36.757675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:36.758108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:36.758559 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:36.759450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:36.759908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:36.761429 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92710-97ef-4c69-a894-9dd3bdee5590 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:36.767356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 435/887] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:36.775893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:36.884385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b6d47-b077-4879-a67e-0ecc82504711 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:36.919670 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:36.920343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:36.920633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:36.920917 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:36.921638 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:36.921950 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:36.923382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477765f1-6651-4a86-9e53-0d933e12b665 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:36.925558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:36.929278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 453/888] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:37.331164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367e52-2c85-4cd4-a7f3-a90fce73a87e None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:37.331675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367e52-2c85-4cd4-a7f3-a90fce73a87e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:37.331776 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367e52-2c85-4cd4-a7f3-a90fce73a87e None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:37.333408 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 436/889] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:37.338904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:37.339326 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:37.339512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:37.357494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:37.358696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:37.434850 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 454/890] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:37.459413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76367e52-2c85-4cd4-a7f3-a90fce73a87e None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:37.579831 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76367e52-2c85-4cd4-a7f3-a90fce73a87e None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:37.616541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:37.617333 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:37.617625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:37.617902 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:37.629186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:37.638067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:37.638916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:37.639648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:37.640196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 437/891] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:24:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:37.645261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:37.756865 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de738ee-a012-4208-96ab-2ba49f77d264 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:37.788064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:37.796039 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:37.796736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:37.797026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:37.797308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:37.798074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:37.798389 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:37.799814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:37.809338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 455/892] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:24:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:37.814488 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:37.835139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:37.932450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9b636-a274-4500-b931-5f3c12b56c02 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:37.968542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:37.969709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:37.970196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:37.970677 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:37.981878 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:37.983621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:38.006695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:38.007528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:38.008286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:38.008286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:38.008286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:38.008286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:38.008476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 438/893] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:38.013571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.131349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b673f-e7e4-40d5-a527-ecc2ff384296 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.167243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.167925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.168217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.168500 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.169237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:38.169553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.170979 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93383-925f-4804-8438-88b04617a0fe None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.184659 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 456/894] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:38.190076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.255298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:38.271717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d40c4-2ead-4734-8df5-7686abe90c93 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.272011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d40c4-2ead-4734-8df5-7686abe90c93 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.272295 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d40c4-2ead-4734-8df5-7686abe90c93 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.273973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 457/895] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:38.279396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.279675 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.279958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.298131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:38.299516 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:38.306977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a1bd5-974c-4dab-a9fe-13d5ee8dc69b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.342764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.343625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.344072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.344494 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.353338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.356134 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.375162 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:38.380210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:38.381577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:38.382388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:38.382876 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 458/896] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:38.391072 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 439/897] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:38.392448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.406556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.524846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40a95f-6e08-40fe-8ecb-c6fb0dead8d6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.532952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83b9e5-03c3-4f95-8022-54a33a530596 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.543232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:38.568093 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.569226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.569610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.569964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.570718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.572363 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.580163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.581094 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.581556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.582034 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.583821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:38.584316 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.585962 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:38.591292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:38.592139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:38.592865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:38.599281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 440/898] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:38.600441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.610645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 459/899] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:38.617913 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.666929 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:38.728277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39a0a-503d-4316-a1f5-f201194facd3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.737312 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819d82f-e3af-4440-9c42-8bebe396134d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.764076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.764750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.765040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.765324 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.766039 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:38.766352 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.767753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcef0e-73e2-4e6a-a267-d1fa2d71da39 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.772992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 441/900] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:38.774216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a05a-5d1a-4c82-8be2-cbb014a71ded None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.774505 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a05a-5d1a-4c82-8be2-cbb014a71ded None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.774802 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a05a-5d1a-4c82-8be2-cbb014a71ded None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.776272 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 442/901] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:38.780890 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.781237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7a05a-5d1a-4c82-8be2-cbb014a71ded None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:38.781948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.782412 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.782928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.831889 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:38.863265 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.865008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.899458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7a05a-5d1a-4c82-8be2-cbb014a71ded None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:38.911316 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:38.938090 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:38.938998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.939421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.939947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.940952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:38.941269 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:38.942729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef8d2-7f24-47b8-8cc3-547a90230abb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:38.948202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 443/902] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:38.949375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:38.949669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:38.949951 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:38.967274 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:38.968699 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:38.979247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 460/903] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:24:38.980102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.052809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 444/904] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:39.053433 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.105598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a161-ef75-48ea-a5f5-b01e21446d27 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.110041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.144695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.145891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.146241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.146532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.147363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] RBAC: Adding query filter params (interface=public, service_id=c276c2d238fd4d31a0b3ce73c951c936, region_id=RegionOne) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:39.147684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.149103 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.158921 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 461/905] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:38 2022] GET /identity/v3/endpoints?service_id=c276c2d238fd4d31a0b3ce73c951c936&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:39.158921 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.161778 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.176149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe750-d02e-42dd-9c4f-e90b3c1d95cc None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.214782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.215608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.215887 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.216164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.226668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.228139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:39.245654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:39.246727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:39.247556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:39.247556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:39.247556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:39.247556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:39.247556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 445/906] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:39.248287 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.264443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d293f3-fa30-45d1-9250-2d3ad26d9896 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.297539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.298334 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.298621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.298939 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.299603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.300993 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-7681e82d-d7df-4cba-817b-870029022c6b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:39.313603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:39.314480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:39.315237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 462/907] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:39.316071 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd9edb-ffef-47b0-ad82-5733c731d952 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.316310 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd9edb-ffef-47b0-ad82-5733c731d952 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.316570 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd9edb-ffef-47b0-ad82-5733c731d952 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.318442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 463/908] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:39.319176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd9edb-ffef-47b0-ad82-5733c731d952 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.343275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.352789 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c3019-54bb-4e89-a315-f143ba1b700c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.387452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.387916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.388375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.388982 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.389271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.389987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.391367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.397335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 446/909] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:24:39.398116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.431392 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd9edb-ffef-47b0-ad82-5733c731d952 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.471064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.471747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.472031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.472309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.473077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:39.473387 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.474876 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7bce6-baa8-490f-886f-a17f2e7137ed None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.487656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 464/910] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:39.489045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.489353 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.489635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.507458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:39.508679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:39.519358 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4893-daec-410a-ba31-64308ff2a1ab None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.564039 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.565009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.565806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.566235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.569632 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:39.570163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.573625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.579736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 447/911] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:39.580838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.587623 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 465/912] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:39.588545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.608453 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.654646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.699814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5247a-361e-4351-ab1b-e877fbdd2c43 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.700199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b301b90-05f7-4d96-a15d-904f93034d49 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.737002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.737682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.737971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.738090 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.738275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.739529 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.739626 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:39.739819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.739922 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.740099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.741223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.746651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 466/913] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:39.747383 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.752259 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.753750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:39.768103 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:39.768932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:39.769695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 448/914] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:39.771266 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.859043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f65f2-b264-40df-acc5-213f75bbd450 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.867256 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.883650 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:39.890204 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8c728-1561-4f23-a19e-cff827717d96 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:39.897185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.898011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.898309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.898590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.899362 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.900886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.926817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 467/915] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:39 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:39.926817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:39.937481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:39.938160 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:39.938448 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:39.938728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:39.939579 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:39.941049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:39.969476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 449/916] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:40.056696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960dfc-40b8-42ca-bce8-d1cf62f78d53 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:40.109401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:40.110541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:40.111086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:40.111807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:40.112889 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:40.113360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:40.115161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e295e-1fda-4507-9961-ad303ae1d205 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:40.136761 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 468/917] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:40.139986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:40.258152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ea29e-c87f-42d9-8c17-8eaf6c5d90c3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:40.293591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:40.300328 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:40.301147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:40.301867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:40.302147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:40.303735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] RBAC: Adding query filter params (role.id=c1b951086f6c4cb3bd57e8a45f64ee1a, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=5c2b4134112f44839cf3194ccddc1ec8) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:40.304977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:40.305951 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96931f-721d-430a-8a82-d0d993b0c912 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:40.312727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 450/918] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:40 2022] GET /identity/v3/role_assignments?user.id=5c2b4134112f44839cf3194ccddc1ec8&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=c1b951086f6c4cb3bd57e8a45f64ee1a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:41.663478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b066b-19ee-44f5-852c-97b636dd8064 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:41.663994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b066b-19ee-44f5-852c-97b636dd8064 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:41.664099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b066b-19ee-44f5-852c-97b636dd8064 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:41.665557 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 469/919] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:41.671043 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:41.671860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:41.672342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:41.689904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:41.691403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:41.760542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 451/920] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:41.784271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b066b-19ee-44f5-852c-97b636dd8064 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:41.827464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:41.898256 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b066b-19ee-44f5-852c-97b636dd8064 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:41.937461 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:41.938289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:41.938578 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:41.938887 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:41.939559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:41.940963 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:41.954276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:41.955188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:41.955972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 470/921] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:24:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:41.962609 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.074562 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76c5b1-fab4-4d8d-93fb-51faae8e4768 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.107271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:42.118160 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.118896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.119582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.119866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.120609 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:42.120970 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.122614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d045-fa49-4cf3-a6bc-b13dc32b3d72 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.128672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 452/922] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:42.134001 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.242934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066abbb8-196f-4570-bb47-7c8995dd4177 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.244875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:42.286148 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.286868 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.287163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.287447 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.288182 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:42.288498 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.289960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.296496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 471/923] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:42.299651 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95f35-6137-4490-b03b-8b56de26d073 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.300121 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95f35-6137-4490-b03b-8b56de26d073 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.300495 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95f35-6137-4490-b03b-8b56de26d073 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.302521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.302638 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 453/924] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:42.308668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.308978 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.309235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.327615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:42.328838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:42.406903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 454/925] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:42.411807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1daad-da87-4ea2-8bf3-c116f82c311f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.423019 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.449740 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f538-7dfe-47b8-ac9e-00dbfe305025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.450831 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f538-7dfe-47b8-ac9e-00dbfe305025 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.451140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f538-7dfe-47b8-ac9e-00dbfe305025 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.451705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f538-7dfe-47b8-ac9e-00dbfe305025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.453007 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f538-7dfe-47b8-ac9e-00dbfe305025 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.455048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f538-7dfe-47b8-ac9e-00dbfe305025 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.489025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 472/926] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:24:42.498480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535ba3-8c03-49c7-88d0-9d40fe5e7ff1 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.499061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535ba3-8c03-49c7-88d0-9d40fe5e7ff1 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.499538 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535ba3-8c03-49c7-88d0-9d40fe5e7ff1 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.502718 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 473/927] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:42.509076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.509364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.509649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.529217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:42.530630 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:42.554973 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c357c-0ec6-475b-a88a-5f73b06d9ed2 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.561965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:42.585196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:42.610619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.611654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.612046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.612430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.613213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.615583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:42.630421 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:42.631661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:42.632584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:42.634102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 455/928] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:42.636443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 474/929] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:42.648318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.665773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.766604 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead275a1-29e7-4f75-8ef5-00d0554635a6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.786729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe14c-c278-46cb-aabd-5e8617efbca4 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.801612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.802284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.802572 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.802876 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.803587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:42.803890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.805251 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020da6f4-3fa6-4007-98a7-7532b31fb565 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.809983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 456/930] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:42.811419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff462175-0f5a-4465-930e-2d52e4d4e607 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.811710 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff462175-0f5a-4465-930e-2d52e4d4e607 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.811990 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff462175-0f5a-4465-930e-2d52e4d4e607 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.813418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 457/931] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:42.818606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff462175-0f5a-4465-930e-2d52e4d4e607 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.831919 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.832710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.833018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.833281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.834110 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.835743 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.837253 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: WARNING keystone.server.flask.common [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:24:42.864250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.sql.core [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:24:42.864250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:24:42.864250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [parameters: {'id': '31997f635c0241ef878ee7242db8a36e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:24:42.864250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143652) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:24:42.867425 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-a321ef62-d9cd-4a82-bb80-1c16aadd3024 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31997f635c0241ef878ee7242db8a36e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31997f635c0241ef878ee7242db8a36e. May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application conn.query(q) May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:24:42.873622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result.read() May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 14:24:42.874361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application next(self.gen) May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application yield resource May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application next(self.gen) May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise self.value May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application session.commit() May 19 14:24:42.880225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.session.flush() May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application compat.raise_( May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:24:42.881293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:24:42.882314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application conn.query(q) May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application result.read() May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:24:42.883154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [parameters: {'id': '31997f635c0241ef878ee7242db8a36e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:42.883937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:42.884652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31997f635c0241ef878ee7242db8a36e. May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 475/932] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:24:42 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.885457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.886040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.898289 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:42.899862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:42.902140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:42.938914 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff462175-0f5a-4465-930e-2d52e4d4e607 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:42.975321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:42.976000 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:42.976288 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:42.976568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:42.986906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:42.987033 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 476/933] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:42.987138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:42.987210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:42.987275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:42.992087 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 458/934] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:42.999181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.104866 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd43-fb4d-4ffb-923f-2c97f3c680f1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.107404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47378740-91c6-4ad8-b3fa-7b007e72b56a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.114711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:43.143064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.143829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.144117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.144399 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.145376 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.145767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] RBAC: Adding query filter params (interface=public, service_id=806e2c0b6686465ea042967e8753cb12, region_id=RegionOne) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:43.146086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.146456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.146866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.147252 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.147492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.154595 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.159931 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 459/935] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:42 2022] GET /identity/v3/endpoints?service_id=806e2c0b6686465ea042967e8753cb12&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:43.159931 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.160144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.161720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:43.180136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:43.181163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:43.182155 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:43.188545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 477/936] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:43.188545 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.274707 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08477d6-d6fa-402f-ab8f-283da02f8c1d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.296535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45978321-c7c7-42ba-a103-5463b351d51f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.310680 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.311526 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.311796 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.312079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.322846 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:43.331078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:43.331917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:43.333245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 460/937] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:43.334140 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.337762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.339047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.339047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.339047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.339716 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.341115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.359259 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 478/938] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:24:43.359259 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.382687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:43.431937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:43.481053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91520-469d-4399-8cf1-55d86a9fc90c None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.483089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914d9a-8c22-445f-8639-20635e999c01 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.526002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.527141 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.527418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.527825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.528096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.528195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.528373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.528859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.529149 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:43.529457 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.530337 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:43.530861 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.530975 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.532730 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.543589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 479/939] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:43.551432 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.554893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 461/940] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:43.687844 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ffbd2-61e5-4e34-b1f9-8caa74b71475 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.715446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:43.730067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.730940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.731231 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.731512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.744619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.746384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:43.766000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:43.766878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:43.767935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:43.767935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:43.767935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:43.767935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:43.767935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 480/941] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:43.772911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:43.878413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:43.889717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9735-8540-4bd7-893d-fd3a439eef92 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:43.926002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:43.926687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:43.927060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:43.927350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:43.928088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:43.928404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:43.929785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:43.942726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 462/942] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:43.947744 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.051582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5110-0754-4e0c-96dc-b9e8b9f36ec4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:44.090171 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:44.091472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.091954 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.092456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.101083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:44.102930 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:44.118405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:44.119319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:44.120167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:44.123003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 481/943] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:24:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:44.134188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.240407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c2d2-afdd-4309-8aa1-f4cf86ec6bea None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:44.277467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:44.278486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.279018 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.279474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.280521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:44.281011 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:44.282607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:44.302138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 463/944] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:24:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:44.307995 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.347928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:44.417423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26c694-56f2-4ae1-b8fb-85b36e31fb0d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:44.452199 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:44.452996 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.453282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.453563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.465274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:44.466741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:44.484818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:44.485682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:44.486544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:44.486544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:44.486544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:44.486544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:44.486544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 482/945] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:44.492847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.506289 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:44.603926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337d3c3-5009-4ed4-9380-f644ad2cc1da None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:44.644262 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:44.645618 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.645909 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.646192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.646988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:44.647304 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:44.648716 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8134-aba5-4ce5-8542-7694ae2dc2c1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:44.662148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 464/946] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:44.667617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.763131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:44.777783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5c66-5094-42b4-a277-fa710aebc9a4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:44.814080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:44.814906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.815193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.815474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.823616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:44.825425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:44.825789 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabbcde-9095-432e-bd30-1f75bdddeb8d None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.826227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabbcde-9095-432e-bd30-1f75bdddeb8d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.826387 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabbcde-9095-432e-bd30-1f75bdddeb8d None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.827977 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 465/947] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:44.833646 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:44.833946 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:44.834226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:44.852271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:44.853472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:44.855203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:44.855986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:44.856801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:44.859301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 483/948] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:44.866850 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.921166 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:44.935084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 466/949] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:44.952135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:44.976426 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15a99-7602-4bb2-b4df-081089db97e5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:45.013305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:45.014916 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.015417 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.016138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.017630 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:45.018238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:45.020932 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:45.037565 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 484/950] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:45.045462 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:45.055211 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:45.067944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a3c55-0ff8-4549-8ec0-4368a12ee806 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:45.105898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:45.107045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.107536 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.108095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.108903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:45.110498 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:45.125207 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:45.126254 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:45.127028 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:45.134869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 467/951] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:45.136019 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:45.167588 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37953ab-f68e-432c-adad-6b53f884821d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:45.205381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:45.214104 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:45.215523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.216832 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.217325 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/5c2b4134112f44839cf3194ccddc1ec8/roles/c1b951086f6c4cb3bd57e8a45f64ee1a` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.219873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=5c2b4134112f44839cf3194ccddc1ec8, role_id=c1b951086f6c4cb3bd57e8a45f64ee1a)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:45.222008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:45.252277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95ae4-b11b-4cfd-a9fc-2666869e43c3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:45.258296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 485/952] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:24:45 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/5c2b4134112f44839cf3194ccddc1ec8/roles/c1b951086f6c4cb3bd57e8a45f64ee1a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:24:45.297448 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:45.298061 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.298346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.298625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.299585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:45.299909 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:45.302049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fedb9-f588-4e98-ad7a-e9b1d16805e9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:45.308353 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 468/953] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:45.314177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:45.393121 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:45.435221 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633721-ab96-4205-a084-f02e7654c2f7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:45.473971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:45.474648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.474997 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.475342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.476068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] RBAC: Adding query filter params (type=compute) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:45.476380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:45.477801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f4fd-7ce5-4366-b214-d3e23d427d1b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:45.483115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 486/954] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:45.779818 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea009-8ef4-44b2-a3ae-8bd10f2833b5 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.780189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea009-8ef4-44b2-a3ae-8bd10f2833b5 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.780397 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea009-8ef4-44b2-a3ae-8bd10f2833b5 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.781906 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 469/955] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:45.787541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:45.788394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:45.788867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:45.807142 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:45.808672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:45.890908 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 487/956] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:45.907326 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ea009-8ef4-44b2-a3ae-8bd10f2833b5 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.025567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ea009-8ef4-44b2-a3ae-8bd10f2833b5 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.055790 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:46.064032 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.064856 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.065144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.065483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.066157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.067690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-824bc173-cfe0-4bde-9807-089a9db89c07 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:46.080368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:46.081377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.083112 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 470/957] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:46.090125 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.161610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:46.183023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163fe6a-8255-46d5-b63c-d26931002a6d None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.183330 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163fe6a-8255-46d5-b63c-d26931002a6d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.183908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163fe6a-8255-46d5-b63c-d26931002a6d None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.185587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 471/958] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:46.190456 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.190904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.191195 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.205764 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff4432-cc9b-4dec-91af-3892d137373f None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.210267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:46.211497 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:46.250115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.250813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.251102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.251385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.252104 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:46.252413 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.255092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.261868 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 488/959] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:46.267244 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.291067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 472/960] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:46.312607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.402818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a4fa3-d683-46fa-b136-929e87d99f29 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.427850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37902-6c53-4c72-8777-e495bc2d3696 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.434423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:46.446456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.447131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.447422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.447780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.448427 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:46.448736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.450133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.457940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 489/961] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:46.462460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:46.465002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.478123 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.479113 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.479410 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.479695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.480412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.482237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.484379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: WARNING keystone.server.flask.common [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:24:46.501232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.sql.core [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:24:46.501232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:24:46.501232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [parameters: {'user_id': 'b1af843f9f354a11a89660b0e6f50be0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:24:46.501232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143653) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application conn.query(q) May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application result.read() May 19 14:24:46.520583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:24:46.521426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application next(self.gen) May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application yield resource May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application next(self.gen) May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise self.value May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application session.commit() May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:24:46.522486 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self.session.flush() May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application compat.raise_( May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:24:46.523611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:24:46.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application conn.query(q) May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application result.read() May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:24:46.525236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b1af843f9f354a11a89660b0e6f50be0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:46.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 14:24:46.527331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.529073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 473/962] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:24:46 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:46.529805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.598720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532058-fb8b-4f39-8b81-0f80da0a6384 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.646922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61580ea9-b782-4aa8-a11c-b048cbb6a310 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.647555 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.648229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.648517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.648802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.649818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.651719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.682837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 490/963] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:24:46.703942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.704771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.705056 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.705336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.715895 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.717733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-af59c5f9-5da3-446e-aaa6-d9e37ce4d30e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:46.736279 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:46.738838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:46.739703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 474/964] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:24:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:46.743945 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:46.797481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:46.872600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39ac1-71d4-4477-94c6-df196acc0884 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:46.914609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:46.915928 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:46.916303 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:46.916672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:46.917586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:46.917975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:46.921161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf6f5-e71e-48ce-8773-f7646fa56508 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:46.963527 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 491/965] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:24:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:47.611074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2bd30-c5ce-4756-897f-03c444e7b8cb None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:47.611592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2bd30-c5ce-4756-897f-03c444e7b8cb None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:47.611664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2bd30-c5ce-4756-897f-03c444e7b8cb None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:47.613163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 475/966] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:47.619031 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681cb29-abbf-458b-939e-02cd5fcdd787 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:47.619333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681cb29-abbf-458b-939e-02cd5fcdd787 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:47.619619 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681cb29-abbf-458b-939e-02cd5fcdd787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:47.638299 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-5681cb29-abbf-458b-939e-02cd5fcdd787 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:47.640585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-5681cb29-abbf-458b-939e-02cd5fcdd787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:47.717138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 492/967] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:47.740177 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2bd30-c5ce-4756-897f-03c444e7b8cb None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:47.784749 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:47.855064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2bd30-c5ce-4756-897f-03c444e7b8cb None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:47.876182 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f8440-d9ed-4e9b-a7b0-27176ea4b344 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:47.876652 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f8440-d9ed-4e9b-a7b0-27176ea4b344 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:47.876725 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f8440-d9ed-4e9b-a7b0-27176ea4b344 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:47.878204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 493/968] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:47.883722 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de6fb-591d-404b-b065-a777894c982c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:47.884008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de6fb-591d-404b-b065-a777894c982c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:47.884290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de6fb-591d-404b-b065-a777894c982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:47.892700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:47.893519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:47.893806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:47.894082 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:47.902032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-892de6fb-591d-404b-b065-a777894c982c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:47.903401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-892de6fb-591d-404b-b065-a777894c982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:47.905721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:47.914281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:47.915489 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:47.916533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 476/969] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:24:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:47.921931 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:47.940779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:47.987690 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 494/970] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:48.011481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de6fb-591d-404b-b065-a777894c982c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:48.035697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:48.039348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48d206-5832-4eff-b761-7f2e71e4d3be None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:48.076893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:48.077575 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:48.077860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:48.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:48.078939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:48.079261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:48.080640 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:48.090829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 477/971] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:24:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:48.094671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:48.130689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de6fb-591d-404b-b065-a777894c982c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:48.165997 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:48.166677 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:48.166991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:48.167269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:48.168008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:48.169409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:48.185139 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 495/972] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:48 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:24:48.204522 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edb794-a136-4861-958f-07dc38d411c1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:48.253117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:48.254592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:48.254900 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:48.255183 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:48.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:48.273549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:48.298371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:48.299308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:48.308239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:48.308239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:48.308239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:48.308239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:48.308239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 478/973] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:48.311457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:48.346490 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:48.450984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29570ee-b662-4d3e-83da-ad38f84789a5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:48.493852 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:48.494537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:48.494853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:48.495140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:48.496298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:48.496611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:48.501355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:48.518721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 496/974] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:48.520481 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:48.534568 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:48.634349 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3227f-015f-425f-aa87-38b08dd1d8ae None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:48.679600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:48.680469 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:48.680757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:48.681138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:48.691192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:48.692648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:48.709444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:48.710317 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:48.717185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 479/975] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:24:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:48.719823 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:48.818830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:48.836685 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6fe7d-269d-44d7-a288-6fd69a7d2d37 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:48.876745 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:48.877525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:48.877716 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:48.877972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:48.879560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:48.879881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:48.881361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942209-eb8e-460d-b2dd-1566ef12fe8f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:48.906621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 497/976] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:24:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:48.907876 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:48.980691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.014196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159bd96-2a04-4c68-ade2-2258361944ff None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.058747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.059438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.059719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.059992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.085124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3216dd-5f1b-4e14-b20c-df3adfc70ad7 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.085419 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3216dd-5f1b-4e14-b20c-df3adfc70ad7 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.085697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3216dd-5f1b-4e14-b20c-df3adfc70ad7 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.087720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 498/977] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:49.093229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.093551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.093812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.111330 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:49.112534 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:49.137671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.139165 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.187852 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 499/978] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:49.211274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.214953 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.252190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 480/979] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:48 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:24:49.258091 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.282878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.314003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecd7b-8ea6-424d-93ca-1d6b9a16eb36 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.352466 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.353273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.353559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.353834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.354485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.355907 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.367448 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac402a06-d683-4c64-a938-4545f88412c6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:49.369573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:49.370464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:49.371912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 500/980] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:49.376957 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.414142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.414978 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.415268 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.415548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.426716 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.428218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:49.446578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:49.447785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:49.448786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:49.448786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:49.448786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:49.448786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:49.452777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 481/981] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:49.453592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.480466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.496664 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91f52-3244-429d-96a1-4df8231b62c6 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.537095 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.537683 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.537967 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.538245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.538981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:49.539290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.542616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.552363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 501/982] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:49.553521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.564234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38d634-b24a-4c96-b4ad-13df9ee917cc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.602771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.603631 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.603920 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.604200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.604933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:49.605252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.606623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.619472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 482/983] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:49.626905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.665892 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817948-232a-4e63-9f85-5e68f9cb7f37 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.702902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.703580 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.703925 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.704209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.704953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:49.705268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.706659 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.712347 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 502/984] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:49.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.726105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.747036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdd08b-a8fe-47ec-908a-fa8e32f5140e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.784249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.785150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.786302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.786608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.786984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.793760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.795169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:49.809865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:49.810679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:49.817194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 483/985] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:49.817643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.831613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6cb1-ad82-456b-8ad3-e4575a170b2e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.867345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.868011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.868300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.868583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.869388 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] RBAC: Adding query filter params (interface=admin, service_id=806e2c0b6686465ea042967e8753cb12, region_id=RegionOne) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:49.869704 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.871370 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.876704 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 503/986] 10.222.0.71 () {56 vars in 1249 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/endpoints?service_id=806e2c0b6686465ea042967e8753cb12&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:49.882127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.935964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c9e78-95eb-4f48-ab41-7ebe5209d5b9 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:49.971755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:49.972939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:49.973303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:49.973585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:49.974396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:49.974697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:49.976159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:49.988650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 484/987] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:49.994400 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:49.997504 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:49.997704 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387245dc-bdbc-43cb-81f4-dc587f6679ba None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:50.025964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:50.035467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5c6f-f7a0-4b5e-a312-37bcad7f4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:50.036144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5c6f-f7a0-4b5e-a312-37bcad7f4424 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:50.036430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5c6f-f7a0-4b5e-a312-37bcad7f4424 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:50.036710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5c6f-f7a0-4b5e-a312-37bcad7f4424 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:50.037402 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c5c6f-f7a0-4b5e-a312-37bcad7f4424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:50.038816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c5c6f-f7a0-4b5e-a312-37bcad7f4424 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:50.046081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 504/988] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:24:50.118504 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd99c75-79fd-4295-b70f-6616747eb25b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:50.157102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:50.158152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:50.158642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:50.159153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:50.160773 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] RBAC: Adding query filter params (role.id=c1b951086f6c4cb3bd57e8a45f64ee1a, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=5c2b4134112f44839cf3194ccddc1ec8) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:50.161298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:50.163008 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c179-b993-492b-b737-ddb27f2e2311 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:50.169972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 485/989] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:49 2022] GET /identity/v3/role_assignments?user.id=5c2b4134112f44839cf3194ccddc1ec8&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=c1b951086f6c4cb3bd57e8a45f64ee1a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:50.595764 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1e08f-e749-4139-b466-2ddb2ce16a3a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:50.596111 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1e08f-e749-4139-b466-2ddb2ce16a3a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:50.596333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1e08f-e749-4139-b466-2ddb2ce16a3a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:50.598301 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 505/990] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:50.603608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:50.603900 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:50.604179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:50.622111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:50.623651 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:50.683621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:50.693176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 486/991] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:50.715499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1e08f-e749-4139-b466-2ddb2ce16a3a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:50.821046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1e08f-e749-4139-b466-2ddb2ce16a3a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:50.856333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:50.857133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:50.857418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:50.857695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] PATH_INFO: `/v3/services/compute` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:50.858349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:50.859759 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:50.872891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:50.873814 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:50.874658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 506/992] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:50.881653 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:50.985821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4628e9-c0e5-4838-8d81-08d492b41e1c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:51.020095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:51.020768 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:51.021054 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:51.021334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:51.022051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:51.022364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:51.023757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:51.033285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 487/993] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:51.035393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:51.094442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:51.141689 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117b85-7c9f-4a85-97ba-48974b197885 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:51.174630 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833af099-736f-4529-b137-01b55724f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:51.175324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833af099-736f-4529-b137-01b55724f175 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:51.176144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833af099-736f-4529-b137-01b55724f175 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:51.176418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833af099-736f-4529-b137-01b55724f175 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:51.177128 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833af099-736f-4529-b137-01b55724f175 None admin] RBAC: Adding query filter params (type=compute) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:51.177438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833af099-736f-4529-b137-01b55724f175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:51.178848 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833af099-736f-4529-b137-01b55724f175 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:51.184017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 507/994] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:51.189804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:51.259988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:51.302749 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4511df-6faa-443d-b33d-b3b450d29f35 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:51.337158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:51.337826 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:51.338116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:51.338397 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:51.339227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] RBAC: Adding query filter params (interface=public, service_id=d6fd55f4488041d2897a47af4f86aa92, region_id=RegionOne) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:51.339547 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:51.340919 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a26748-9493-4656-baec-d218c1c478a3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:51.351356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 488/995] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:51 2022] GET /identity/v3/endpoints?service_id=d6fd55f4488041d2897a47af4f86aa92&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:51.353305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833af099-736f-4529-b137-01b55724f175 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:51.458385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833af099-736f-4529-b137-01b55724f175 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:51.479053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:51.493961 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de149a0-b2e7-4f89-b1d2-804bf8ee1e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:51.494631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de149a0-b2e7-4f89-b1d2-804bf8ee1e17 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:51.494944 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de149a0-b2e7-4f89-b1d2-804bf8ee1e17 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:51.495229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de149a0-b2e7-4f89-b1d2-804bf8ee1e17 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:51.496179 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de149a0-b2e7-4f89-b1d2-804bf8ee1e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:51.497561 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de149a0-b2e7-4f89-b1d2-804bf8ee1e17 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:51.510882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 508/996] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:51 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:24:52.324525 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3a984-e60e-4933-8c45-656ed25e4e11 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.325045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3a984-e60e-4933-8c45-656ed25e4e11 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.325117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3a984-e60e-4933-8c45-656ed25e4e11 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.326633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 489/997] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:52.332438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5f77-f5ab-49cc-9da1-f43ac1359945 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.332898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5f77-f5ab-49cc-9da1-f43ac1359945 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.332992 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5f77-f5ab-49cc-9da1-f43ac1359945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.349976 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-be9e5f77-f5ab-49cc-9da1-f43ac1359945 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:52.351220 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-be9e5f77-f5ab-49cc-9da1-f43ac1359945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:52.420974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 509/998] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:52.444245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3a984-e60e-4933-8c45-656ed25e4e11 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:52.481972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976358-b7e3-4546-9945-1e87fa0f37c2 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.482265 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976358-b7e3-4546-9945-1e87fa0f37c2 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.482548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976358-b7e3-4546-9945-1e87fa0f37c2 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.484227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 510/999] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:52.489598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.489894 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.490160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.508415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:52.509621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:52.555764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3a984-e60e-4933-8c45-656ed25e4e11 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:52.583611 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:52.590822 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 511/1000] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:52.598477 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:52.599318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.599606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.599885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.600555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:52.601922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:52.610583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:52.614191 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:52.615162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:52.619571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 490/1001] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:24:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:52.621615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:52.665558 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:52.722826 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4295a1-a941-45fc-8da8-b8811a3efd1b None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:52.733530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e176e-85bc-4397-91c9-f0c6dcfe9bbc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:52.759921 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:52.760680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.761000 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.761248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] PATH_INFO: `/v3/services/image` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.761910 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:52.763346 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:52.769788 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:52.770578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.770892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.771172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.771885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:52.772194 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:52.773558 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:52.775762 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:52.776611 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:52.777399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 512/1002] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:24:52 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:52.782864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:52.783887 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 491/1003] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:52.792185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:52.857539 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:52.902830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d01e3-9796-4de8-b018-fb9e023de966 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:52.908463 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4547b5-a974-4cd1-b724-b6dd92258409 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:52.913892 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:52.941213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:52.941873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.942157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.942431 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.943173 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] RBAC: Adding query filter params (name=image) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:52.943482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:52.944856 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:52.945021 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:52.945655 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:52.945950 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:52.946234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:52.946979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:52.947299 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:52.948655 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:52.950281 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 513/1004] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:52.958226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 492/1005] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:24:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:52.959385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:52.959491 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:53.069071 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc097a2-f9f6-4d46-a023-e7bf840c230b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:53.069926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8189a-794b-44f4-9b48-93515a5edcab None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:53.090569 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:53.114857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:53.115029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9764f-c623-4492-9b9b-ee495b08642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:53.115479 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:53.115688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9764f-c623-4492-9b9b-ee495b08642d None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:53.115782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:53.115975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9764f-c623-4492-9b9b-ee495b08642d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:53.116065 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:53.116256 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9764f-c623-4492-9b9b-ee495b08642d None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:53.116743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] RBAC: Adding query filter params (type=image) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:53.117004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9764f-c623-4492-9b9b-ee495b08642d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:53.117094 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:53.118394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9764f-c623-4492-9b9b-ee495b08642d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:53.118485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755c594-0a40-4d29-9c7c-711a9570e261 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:53.123678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 493/1006] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:53.158836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 514/1007] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:53.775825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f088-b876-48cd-99b1-598b7cfe3ac9 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:53.776368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f088-b876-48cd-99b1-598b7cfe3ac9 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:53.776368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f088-b876-48cd-99b1-598b7cfe3ac9 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:53.777829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 494/1008] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:53.783133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:53.783514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:53.783710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:53.801926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:53.803158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:53.830183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:53.888612 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 515/1009] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:53.912146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f088-b876-48cd-99b1-598b7cfe3ac9 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:54.018556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f088-b876-48cd-99b1-598b7cfe3ac9 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:54.052911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:54.053640 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:54.053925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:54.054206 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] PATH_INFO: `/v3/services/compute` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:54.054952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:54.056318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:54.068130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:54.069029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:24:54.069780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:54.074334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 495/1010] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:54.075610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:54.177493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1435691-04c6-41b9-a640-295a24f253c8 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:54.211453 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:54.212122 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:54.212411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:54.212694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:54.213410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:54.213720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:54.215150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:54.224667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 516/1011] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:54.225897 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:54.277822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:54.337495 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c14f9-4b25-427d-84ce-81c57447f141 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:54.372415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:54.373095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:54.373382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:54.373664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:54.374381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] RBAC: Adding query filter params (type=compute) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:54.374692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:54.376109 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2b4d-b340-4fe4-93be-5e2a07102466 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:54.386590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 496/1012] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:24:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:54.387843 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:54.414590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:54.495067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcef757-98d2-492b-bd35-64ee0a8c81cf None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:54.530143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a132ceb-16b1-4d47-8802-aa129c506006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:54.530821 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a132ceb-16b1-4d47-8802-aa129c506006 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:54.531118 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a132ceb-16b1-4d47-8802-aa129c506006 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:54.531405 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a132ceb-16b1-4d47-8802-aa129c506006 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:54.532152 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a132ceb-16b1-4d47-8802-aa129c506006 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:54.533539 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a132ceb-16b1-4d47-8802-aa129c506006 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:54.553974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 517/1013] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:24:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:55.383310 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844054ec-8f65-4855-a2cf-9977286abeb8 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.383832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844054ec-8f65-4855-a2cf-9977286abeb8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.383905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844054ec-8f65-4855-a2cf-9977286abeb8 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.385283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 497/1014] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:55.390632 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.391067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.391240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.409238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:55.410459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:55.443744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff955a-882f-4035-8e16-0015a759b533 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.444040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff955a-882f-4035-8e16-0015a759b533 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.444300 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff955a-882f-4035-8e16-0015a759b533 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.445667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 498/1015] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:24:55.452068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.452357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.452636 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.470539 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:55.471765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:55.490935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 518/1016] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:55.510662 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:55.513931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:55.543079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 499/1017] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:55.567704 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:55.610159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:55.617852 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095102a-f0d6-4bbc-bcad-e0605412795c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:55.661724 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:55.662606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.662926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.663475 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.664613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:55.666023 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:55.680327 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81c50-4a08-47ba-a9d2-c2ae18c2f32c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:55.690864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 519/1018] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:55 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:24:55.730466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17441b-6463-4f9d-8472-135ea21a6dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:55.731320 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17441b-6463-4f9d-8472-135ea21a6dbb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.731606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17441b-6463-4f9d-8472-135ea21a6dbb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.731886 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17441b-6463-4f9d-8472-135ea21a6dbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.733107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17441b-6463-4f9d-8472-135ea21a6dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:55.734553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17441b-6463-4f9d-8472-135ea21a6dbb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:55.736440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 500/1019] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:55.742895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:55.814879 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:55.868867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c977-5e01-4ca0-95a1-9a894e162a6f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:55.905204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab1f5c-2917-43e9-a0c0-48c9b016415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:55.905875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1f5c-2917-43e9-a0c0-48c9b016415f None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:55.906160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1f5c-2917-43e9-a0c0-48c9b016415f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:55.906438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab1f5c-2917-43e9-a0c0-48c9b016415f None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:55.907210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab1f5c-2917-43e9-a0c0-48c9b016415f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:55.908658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab1f5c-2917-43e9-a0c0-48c9b016415f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:55.938640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 520/1020] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:24:55 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:56.879361 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418384b-76b6-41ca-ba84-0c7a807596c5 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:56.879802 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418384b-76b6-41ca-ba84-0c7a807596c5 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:56.880189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418384b-76b6-41ca-ba84-0c7a807596c5 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:56.881471 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 501/1021] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:56.886663 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:56.887089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:56.887251 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:56.904238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:56.905422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:56.975834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 521/1022] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:56.998850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418384b-76b6-41ca-ba84-0c7a807596c5 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:57.102373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418384b-76b6-41ca-ba84-0c7a807596c5 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:57.104088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:57.138954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:57.139762 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.140041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.140313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:57.151055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:24:57.159164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:57.160881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:24:57.161647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:57.165853 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 502/1023] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:24:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:57.167222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:57.214334 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:57.270986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9963-b99c-471d-9020-7b2b11717f5f None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:57.305135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:57.305807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.306089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.306368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:57.307157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:57.307468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:57.308851 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:57.322811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 522/1024] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:24:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:57.324273 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:57.426078 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b25a-d90c-4fd4-9154-952dc2feef7f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:57.467533 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:57.468330 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.468612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.468892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:57.480403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:57.481843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:57.499804 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:57.500679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:57.501513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:57.501513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:57.501513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:57.501513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:57.501513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 503/1025] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:57.508147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:57.611829 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bed83-22a4-49c9-ad66-58e5998bb674 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:57.622236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:57.649258 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:57.649926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.650208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.650485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:57.651235 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:57.651547 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:57.652926 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:57.669610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 523/1026] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:57.671115 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:57.687503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:57.777851 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6cd0-b119-44f3-9623-579d516c60e7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:57.816411 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:57.817177 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.817458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.818852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] PATH_INFO: `/v3/users/nova` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:57.830764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:57.832767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-6be8c2ec-4e43-4b57-8bb9-1830ae1bf49b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:24:57.848987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:57.850004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:57.850937 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 504/1027] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:24:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:57.859627 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:57.964556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96901e7-3a34-48ec-b9f7-0af6521468af None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:57.980807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c570f-0fe3-4493-b32a-7eab5a5863c8 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.981294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c570f-0fe3-4493-b32a-7eab5a5863c8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.981371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c570f-0fe3-4493-b32a-7eab5a5863c8 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:57.982926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 505/1028] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:57.987725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:57.988017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:57.988299 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.000737 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.001418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.001706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.001984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.002869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:58.003218 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.004681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.006917 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:58.008110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:58.026646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 524/1029] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:24:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:58.032707 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.064495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.094837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 506/1030] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:24:58.119771 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.123791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.153228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665826bc-78cc-4f25-b460-a4e3fe478ea0 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.191354 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ad8d6-3b23-4d16-98ee-ec34f3f82e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.192017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad8d6-3b23-4d16-98ee-ec34f3f82e2b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.192302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad8d6-3b23-4d16-98ee-ec34f3f82e2b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.192583 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad8d6-3b23-4d16-98ee-ec34f3f82e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.227674 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd425a-3630-483d-a819-79cf06ce6cd6 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.262210 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.263027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.263183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ad8d6-3b23-4d16-98ee-ec34f3f82e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.263306 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.263567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.264218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.264662 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ad8d6-3b23-4d16-98ee-ec34f3f82e2b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.265552 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-8315493a-27bc-4cd1-9925-381f880302e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:58.277163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:58.278181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:58.279029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 507/1031] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:24:58.279777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6147-fca6-4480-b073-e8fe13ca6ecb None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.279996 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6147-fca6-4480-b073-e8fe13ca6ecb None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.280344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6147-fca6-4480-b073-e8fe13ca6ecb None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.281507 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 508/1032] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:24:58.284264 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6147-fca6-4480-b073-e8fe13ca6ecb None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.294110 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.353891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.369675 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 525/1033] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:24:58.371207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.371501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.371784 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.388191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:24:58.389444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:24:58.392022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6147-fca6-4480-b073-e8fe13ca6ecb None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.427232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.427899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.428178 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.428457 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.429160 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] RBAC: Adding query filter params (name=image) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:58.429467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.430842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.435959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 509/1034] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:24:58.436621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.464057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 526/1035] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:24:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:24:58.465033 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.520950 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.546882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8429-8c2d-4768-8079-be2327a1b205 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.564051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1205-23c4-48b9-9ebf-6fe68f00a768 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.576799 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.582549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.583409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.583691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.583967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.594775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.596238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.599563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.600233 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.600521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.600802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.601514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] RBAC: Adding query filter params (type=image) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:58.601824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.603247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.608047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 527/1036] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:58.608824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:24:58.613750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:58.614775 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:58.615830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:24:58.615830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:24:58.615830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:24:58.615830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:24:58.615830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 510/1037] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:58.615830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.714287 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bcf6-383c-491d-9e82-8beff39ce687 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.714669 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c96df-ca53-4587-86fa-09c5cf7d9e70 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.735002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.748610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.749306 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.749589 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.749927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.750723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] RBAC: Adding query filter params (interface=public, service_id=f2a5022093824d41bde611d3b5ae436c, region_id=RegionOne) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:58.750881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.751068 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.751678 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.751964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.752243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.752425 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.753464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.754948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.756606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 528/1038] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:58.757375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.757819 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 511/1039] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/endpoints?service_id=f2a5022093824d41bde611d3b5ae436c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:58.762863 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.811736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:58.861089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a0918-f614-4c7a-a8ee-1b7da878fa21 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.866296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ef6d-04c0-4de3-9bd6-6b8ee6c29052 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:58.897422 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.898086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.898372 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.898647 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.899404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:58.899712 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.900745 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:58.901086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.901413 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:58.901700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:58.901984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:58.902673 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:58.904055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:58.910616 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 512/1040] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:24:58.911410 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.913243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 529/1041] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:58.924118 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:58.978834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:59.023718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e59a6-9c7e-48ec-abac-6fa1277a6435 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:59.038833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:59.039037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11255f5-f56b-4b53-89bf-71c1f1ad44a5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:59.064339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:59.064998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:59.065284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:59.065621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:59.066348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:59.068189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:59.078843 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:59.079745 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:59.080062 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:59.080433 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:59.088687 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:59.090183 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:59.091346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 513/1042] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:24:58 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:24:59.110631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:24:59.111735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:24:59.113278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 530/1043] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:24:59.119649 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:59.232218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94582b-4313-4621-b532-12aa4957df85 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:59.270470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:59.271190 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:59.271479 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:59.271758 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:59.272570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:59.272893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:59.274334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2d982-655b-4a66-bdaa-c66aeac64b56 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:59.289247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 514/1044] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:24:59.295302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:24:59.405492 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d598e-c003-4d12-8631-192803aff0c0 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:24:59.415797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:24:59.443688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:24:59.444360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:24:59.444651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:24:59.444936 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:24:59.445778 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] RBAC: Adding query filter params (role.id=c1b951086f6c4cb3bd57e8a45f64ee1a, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dc16b79859ae48a2a54a68666fc9dc1f) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:24:59.446096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:24:59.447582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18922134-bcb1-4837-92cb-710d10fc75f2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:24:59.458816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 531/1045] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:24:59 2022] GET /identity/v3/role_assignments?user.id=dc16b79859ae48a2a54a68666fc9dc1f&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=c1b951086f6c4cb3bd57e8a45f64ee1a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:01.199854 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6237a0-50fa-4cf2-851d-fd88927e1641 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.200396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6237a0-50fa-4cf2-851d-fd88927e1641 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.200396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6237a0-50fa-4cf2-851d-fd88927e1641 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.201839 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 515/1046] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:01.208645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2882-df65-467f-b331-a82b44eb4ef6 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.209190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2882-df65-467f-b331-a82b44eb4ef6 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.209190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2882-df65-467f-b331-a82b44eb4ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.228359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-475a2882-df65-467f-b331-a82b44eb4ef6 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:01.229594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-475a2882-df65-467f-b331-a82b44eb4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:01.301971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 532/1047] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:01.324629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6237a0-50fa-4cf2-851d-fd88927e1641 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.353504 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:01.399177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecfea0-051a-4eb8-885b-c59f9695ffe7 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.399538 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecfea0-051a-4eb8-885b-c59f9695ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.399895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecfea0-051a-4eb8-885b-c59f9695ffe7 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.401532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 533/1048] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:25:01.406521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.406833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.407119 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.423781 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:01.425002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:01.433828 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6237a0-50fa-4cf2-851d-fd88927e1641 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:01.474402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:01.475290 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.475577 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.475852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.476899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:01.478264 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:01.490482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:01.491512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:01.492323 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 516/1049] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:25:01 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:01.498289 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.502391 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 534/1050] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:25:01.526390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.559969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:01.604845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:01.614832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ea55b-5681-437a-99cb-f14449a8a3e5 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:01.641873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d203e1-0331-4122-ae72-28508047bf83 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:01.650989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:01.651663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.651943 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.652224 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.652932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] RBAC: Adding query filter params (name=image) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:01.653244 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:01.654698 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:01.660213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 517/1051] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:01.665678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.683452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3d760-2ba4-43ec-a966-735f60fadc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:01.684256 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d760-2ba4-43ec-a966-735f60fadc5b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.684535 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d760-2ba4-43ec-a966-735f60fadc5b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.684817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d760-2ba4-43ec-a966-735f60fadc5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.696126 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3d760-2ba4-43ec-a966-735f60fadc5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-afe3d760-2ba4-43ec-a966-735f60fadc5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:01.703833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:01.704720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:01.705502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 535/1052] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:25:01.706813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c4d0-b419-43a7-bf26-2d66388e9abe None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.707438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c4d0-b419-43a7-bf26-2d66388e9abe None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.707438 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c4d0-b419-43a7-bf26-2d66388e9abe None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.708773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 536/1053] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:01.711492 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c4d0-b419-43a7-bf26-2d66388e9abe None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.768889 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1425f-e51f-41df-890b-0b1b5913f2bc None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:01.802947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:01.803612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.803895 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.804173 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.804879 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] RBAC: Adding query filter params (type=image) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:01.805187 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:01.805608 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:01.806549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f833-3213-4853-8029-c3d153117e28 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:01.812140 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 518/1054] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:01.813357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.813648 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.813929 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.817035 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c4d0-b419-43a7-bf26-2d66388e9abe None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:01.831556 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:01.832744 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:01.848013 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:01.859238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:01.859918 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:01.860206 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:01.860488 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:01.861246 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:01.861559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:01.863877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:01.872343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 537/1055] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:01.873129 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.905198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 519/1056] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:01.906066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:01.975064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c6a81-f176-4c40-8299-2bf54fb23816 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.009181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b84cf-86f6-4800-8890-84ab20c9a540 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.009648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.010304 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.010589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.010951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.011696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.013076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.032071 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 538/1057] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:25:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:02.032812 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.058082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.061942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.063249 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.063713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.064138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] PATH_INFO: `/v3/users/99d93f5924a24967831dea363dca3b8a` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.079983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] RBAC: Authorizing `identity:get_user(user_id=99d93f5924a24967831dea363dca3b8a)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.081770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.083726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 520/1058] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:01 2022] GET /identity/v3/users/99d93f5924a24967831dea363dca3b8a => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:02.089765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.094440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.167532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a50b8-3b2a-495a-b40f-e77993d062f8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.210017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab1b6-d3b8-47d4-afa6-f4ab3c6d258b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.212360 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.213694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.213694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.213884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.225875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:02.234262 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:02.235190 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:02.235994 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 539/1059] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:02.241922 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.251463 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.252130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.252417 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.252752 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.326174 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.328500 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.329959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.333438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.361210 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d02fd-61b0-4f36-89af-70751d36c91a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.400516 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.401585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.401585 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.401755 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.402467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:02.402830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.404228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.414016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 540/1060] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:02.419576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.447138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 521/1061] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:25:02.452452 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.540727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74363f-9fe0-4139-8f2b-99d166a79972 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.568379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d30a8-b931-4376-89f7-0a2194d102f6 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.571747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.574841 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.580491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.581328 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.581666 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.581949 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.593424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.594985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.608314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.609189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.609474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.609753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.610979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] RBAC: Authorizing `identity:get_project(project_id=331fe15bb9af450c81f06a963a9bb640)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.612964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:25:02.613465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:02.614243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:02.620597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:25:02.620597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:25:02.620597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:02.620597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:02.620597 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 541/1062] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:25:02.620858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 522/1063] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:02.620937 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.621163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.731131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d55af-724e-46e0-bd3f-d0c39942bba4 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.734098 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab311b9-a524-407c-b0cf-609a3018ef39 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.769272 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.770311 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.770824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.771305 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.771409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.771982 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.772271 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.772567 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.773096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:02.773400 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=331fe15bb9af450c81f06a963a9bb640, user.id=99d93f5924a24967831dea363dca3b8a) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:02.773721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.774021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.775198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.775885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:02.781346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 523/1064] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/role_assignments?user.id=99d93f5924a24967831dea363dca3b8a&scope.project.id=331fe15bb9af450c81f06a963a9bb640&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:02.797320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 542/1065] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:02.803760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:02.857654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:02.939167 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7243f-d307-4704-b5f1-b631bbb031b0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:02.977432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:02.978241 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:02.978526 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:02.978820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:02.986733 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:02.988713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:25:03.004200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:03.005097 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:03.006004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 524/1066] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:25:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:03.011314 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:03.058124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:03.115260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3990c-c914-40b1-9a35-f0dd2ab469be None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:03.150267 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:03.150975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:03.151268 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:03.151551 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:03.152404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:03.152719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:03.154182 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:03.178072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 543/1067] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:25:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:03.179570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:03.281514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:03.288602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19c27e-b15a-4b30-a89d-2cb4c960dcb8 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:03.325969 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:03.326779 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:03.327086 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:03.327364 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:03.338022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:03.339502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:25:03.357723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:03.358571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:03.359440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:25:03.359440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:25:03.359440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:03.359440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:03.363201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 525/1068] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:03.365375 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:03.467236 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047b44-d7ac-40aa-95e6-15fbf6ced2ec None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:03.468834 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:03.505862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:03.506531 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:03.506847 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:03.507130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:03.507857 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:03.508169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:03.509549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:03.521687 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 544/1069] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:03.527088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:03.628319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dedeaf-98ff-4475-8833-4bc8e3378975 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:03.662602 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:03.663427 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:03.663714 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:03.663993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:03.670689 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:03.672155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:25:03.685836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:03.686668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:25:03.687557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:03.688549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 526/1070] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:03.693440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:03.795293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8193e5-8dd2-477f-a789-13b3523c0de5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:03.830557 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:03.831355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:03.831656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:03.831938 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:03.832747 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:03.833060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:03.834911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8359f-528c-42bc-b8f2-f9d889e89530 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:03.857953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 545/1071] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:03.859651 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:03.873332 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:03.968245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce23e-6853-4c08-b8cb-61ae67d94a9f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:04.003706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1b22-1dff-48d5-892f-38e5f48fcf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:04.004609 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1b22-1dff-48d5-892f-38e5f48fcf70 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:04.004893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1b22-1dff-48d5-892f-38e5f48fcf70 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:04.005172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1b22-1dff-48d5-892f-38e5f48fcf70 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dc16b79859ae48a2a54a68666fc9dc1f/roles/c1b951086f6c4cb3bd57e8a45f64ee1a` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:04.007440 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f1b22-1dff-48d5-892f-38e5f48fcf70 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=dc16b79859ae48a2a54a68666fc9dc1f, role_id=c1b951086f6c4cb3bd57e8a45f64ee1a)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:04.008875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f1b22-1dff-48d5-892f-38e5f48fcf70 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:04.023183 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 527/1072] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:25:03 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/dc16b79859ae48a2a54a68666fc9dc1f/roles/c1b951086f6c4cb3bd57e8a45f64ee1a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:25:04.369981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddc51-aa1d-45dd-a9d2-82c6133b3ce6 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:04.370732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddc51-aa1d-45dd-a9d2-82c6133b3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:04.370732 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddc51-aa1d-45dd-a9d2-82c6133b3ce6 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:04.372286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 546/1073] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:04.377498 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:04.377956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:04.378185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:04.395460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:04.396642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:04.462875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:04.474900 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 528/1074] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:04.493350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadddc51-aa1d-45dd-a9d2-82c6133b3ce6 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:04.521087 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:04.618307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadddc51-aa1d-45dd-a9d2-82c6133b3ce6 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:04.653965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:04.654541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:04.654848 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:04.655133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:04.723622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:04.725099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:04.748786 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:04.832032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 547/1075] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:04.833657 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:04.948907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340084a9-d1f8-4bfc-b45b-e6fc35c2070c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:04.983703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:04.984650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:04.984936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:04.985215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:04.995718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:04.997164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-43b1e4b4-2443-4a82-8f31-33841bf8b8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:25:05.020285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:05.021154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:05.026810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:25:05.026810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:25:05.026810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:05.026810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:05.026810 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 529/1076] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:25:05.028705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:05.056156 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057677fd-a825-4488-8fb7-4af3d7c8013d None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.056444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057677fd-a825-4488-8fb7-4af3d7c8013d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.056726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057677fd-a825-4488-8fb7-4af3d7c8013d None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.058106 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 530/1077] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:25:05.063747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.064029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.064324 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.081152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:05.082378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:05.130269 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:05.137621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7634c-e494-4f58-a7c3-3986db56b836 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:05.152371 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 531/1078] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:25:05.163037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:05.176726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:05.177337 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:05.178010 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.178294 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.178568 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.179537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:05.180715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:05.182105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:05.195198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 548/1079] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:05.294809 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce035-daff-4b41-a23f-8dd11b28e8b8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:05.332467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:05.333295 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.333631 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.333859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.345529 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:05.353530 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:05.354483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:05.355924 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 532/1080] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:05.364134 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:05.469310 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83bf41-3a9b-4e71-aa12-801110046281 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:05.507069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:05.507746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.508033 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.508307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.509060 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:05.509373 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:05.510759 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:05.519705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 549/1081] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:05.525825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:05.568469 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:05.628314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de99c-969d-472c-bf8c-2390cd5aed18 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:05.660920 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:05.661784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.662070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.662345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] PATH_INFO: `/v3/users/99d93f5924a24967831dea363dca3b8a` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.663542 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] RBAC: Authorizing `identity:get_user(user_id=99d93f5924a24967831dea363dca3b8a)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:05.664957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:05.666594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 533/1082] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:05 2022] GET /identity/v3/users/99d93f5924a24967831dea363dca3b8a => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:05.672300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:05.718521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:05.778609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16083f4b-0e0f-4028-b060-50b00d57e820 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:05.812802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5674da-bc52-4e97-8d47-7f5f687e2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:05.813671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5674da-bc52-4e97-8d47-7f5f687e2c60 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.813961 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5674da-bc52-4e97-8d47-7f5f687e2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.814245 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5674da-bc52-4e97-8d47-7f5f687e2c60 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.815983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5674da-bc52-4e97-8d47-7f5f687e2c60 None admin] RBAC: Authorizing `identity:get_project(project_id=331fe15bb9af450c81f06a963a9bb640)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:05.817452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5674da-bc52-4e97-8d47-7f5f687e2c60 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:05.823933 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 550/1083] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:05 2022] GET /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:05.825001 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:05.940004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23fae-0475-4c8c-a620-89b3b3e3d05b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:05.948987 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:05.976981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df427-c0b7-46bd-83bc-0d9351ed7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:05.977882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df427-c0b7-46bd-83bc-0d9351ed7285 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:05.978167 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df427-c0b7-46bd-83bc-0d9351ed7285 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:05.978450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df427-c0b7-46bd-83bc-0d9351ed7285 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640/users/99d93f5924a24967831dea363dca3b8a/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:05.980443 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061df427-c0b7-46bd-83bc-0d9351ed7285 None admin] RBAC: Authorizing `identity:create_grant(project_id=331fe15bb9af450c81f06a963a9bb640, user_id=99d93f5924a24967831dea363dca3b8a, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:05.981879 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061df427-c0b7-46bd-83bc-0d9351ed7285 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:05.995410 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 534/1084] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:25:05 2022] PUT /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640/users/99d93f5924a24967831dea363dca3b8a/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:25:06.340791 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d27f-3199-4820-8032-db442d943cbe None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:06.341076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d27f-3199-4820-8032-db442d943cbe None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:06.341358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d27f-3199-4820-8032-db442d943cbe None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:06.342737 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 551/1085] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:06.348672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:06.348961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:06.349237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:06.365983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:06.367198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:06.433598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 535/1086] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:25:06.461057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d27f-3199-4820-8032-db442d943cbe None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:06.565188 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d27f-3199-4820-8032-db442d943cbe None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:06.579529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:06.601644 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:06.602390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:06.602676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:06.602984 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:06.613811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:06.622191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:06.623401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:06.624255 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 552/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:25:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:06.629835 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:06.723991 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:06.727571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550f86-a2df-4ff9-a352-7833782ebdf9 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:06.763738 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:06.764404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:06.764685 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:06.764957 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:06.765705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:06.766012 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:06.767409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:06.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 536/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:25:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:06.781067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:06.882131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2434e-fde6-4a08-a79a-f518eebeab12 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:06.915141 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:06.915929 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:06.916214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:06.916496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:06.927548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:06.929006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:25:06.946263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:06.947169 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:06.948013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:25:06.948013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:25:06.948013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:06.948013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:06.948013 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 553/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:06.953331 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:07.053713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e675b-dd01-4d37-9515-aa173ebc24e2 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:07.087286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:07.087946 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:07.088232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:07.088509 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:07.089237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:07.089592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:07.090980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:07.111316 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 537/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:07.116976 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:07.143942 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:07.218238 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3763c-9b4f-475d-be03-5d3ad3ce65b9 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:07.251208 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:07.252002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:07.252371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:07.253260 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:07.260741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:07.262192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:25:07.276590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:07.277494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:07.278424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 554/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:25:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:07.283517 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:07.305394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:07.383890 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8312-5930-4af0-9916-93598ec699ca None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:07.417114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:07.417718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:07.418003 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:07.418284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:07.419158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:07.419470 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:07.420884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:07.438200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 538/1092] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:25:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:07.443972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:07.530141 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:07.546780 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f6c60-bbd2-4b4c-9b64-e65de93107ff None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:07.579869 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:07.580501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:07.581355 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:07.581634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:07.647986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:07.649446 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:07.730059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:07.747525 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 555/1093] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:07.753959 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:07.831108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:07.856061 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a80b-c3b8-4384-ad34-f4084880a35a None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:07.891639 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:07.892430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:07.892709 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:07.892983 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:07.902750 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:07.904201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:25:07.921891 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:07.922841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:07.923695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:25:07.923695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:25:07.923695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:25:07.923695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:07.923695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 539/1094] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:07.929393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.028056 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b588e6-f8d9-4dd2-b951-ff15c3cacbcc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.063702 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.064362 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.064642 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.064914 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.066178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:08.066482 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:08.067904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d5922-828a-4b4a-8301-bfe1c35a7041 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:08.079131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 556/1095] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:08.085291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.185619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3424-2604-4257-8d96-5e0b8dd4e67d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.211018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9803-2fa7-473a-9686-1bdfc11090dc None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.211298 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9803-2fa7-473a-9686-1bdfc11090dc None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.211582 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9803-2fa7-473a-9686-1bdfc11090dc None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.212968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 557/1096] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:25:08.214589 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:08.217947 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.218306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.218673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.220712 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.222077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.222356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.222629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.229409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:08.230868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:08.236215 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:08.237959 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:25:08.245168 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:08.246007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:08.246918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 540/1097] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:25:08.251954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.279226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:08.307516 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 558/1098] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:08.332818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.361388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc9ad-3093-445c-b366-7377b43070b4 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.395732 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.396396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.396682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.396961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.397752 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:08.398064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:08.399535 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:08.412091 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 541/1099] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:08.417981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.434710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbf8de-debb-4a0b-9021-72f1eb2605d5 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.466231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:08.468789 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.469593 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.469877 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.470154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.482309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:08.490037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:08.490951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:08.491768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 559/1100] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:25:08.497495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.519621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964317f1-c7dd-42c4-95d1-d37031240209 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.533475 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:08.555277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.555945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.556236 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.556513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.557356 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] RBAC: Adding query filter params (role.id=c1b951086f6c4cb3bd57e8a45f64ee1a, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=dc16b79859ae48a2a54a68666fc9dc1f) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:08.557674 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:08.559132 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:08.564879 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 542/1101] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/role_assignments?user.id=dc16b79859ae48a2a54a68666fc9dc1f&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=c1b951086f6c4cb3bd57e8a45f64ee1a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:08.612691 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe6daf-b0ef-4a4e-99a2-ad8adfbff459 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.651064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.651753 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.652040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.652316 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.653083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:08.653394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:08.654829 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:08.664808 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 560/1102] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:08.670736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.777286 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eced9-a3f0-4989-bf12-403e0a0c905e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.792284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:08.813645 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.814521 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.814837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.815117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] PATH_INFO: `/v3/users/99d93f5924a24967831dea363dca3b8a` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:08.816341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] RBAC: Authorizing `identity:get_user(user_id=99d93f5924a24967831dea363dca3b8a)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:08.817786 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:08.819485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 543/1103] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/users/99d93f5924a24967831dea363dca3b8a => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:08.825657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:08.927782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:08.934203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55785-4659-44fe-9fea-16aff004fb95 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:08.969045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:08.969758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:08.970053 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:08.970335 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:09.039420 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:09.040903 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:09.137719 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:09.144945 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 561/1104] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:09.150870 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:09.256016 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d684e-9235-4505-842e-7bad77980680 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:09.291755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75650b6-ba43-40f6-bfd8-4bd55b385011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:09.292634 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75650b6-ba43-40f6-bfd8-4bd55b385011 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:09.292920 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75650b6-ba43-40f6-bfd8-4bd55b385011 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:09.293197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75650b6-ba43-40f6-bfd8-4bd55b385011 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:09.294391 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75650b6-ba43-40f6-bfd8-4bd55b385011 None admin] RBAC: Authorizing `identity:get_project(project_id=331fe15bb9af450c81f06a963a9bb640)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:09.295864 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75650b6-ba43-40f6-bfd8-4bd55b385011 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:09.297594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 544/1105] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:09 2022] GET /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:25:09.304380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:09.406942 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47713e-50f8-4dfd-86c1-a278208b928b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:09.442606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:09.443374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:09.444201 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:09.444201 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:09.444769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=331fe15bb9af450c81f06a963a9bb640, user.id=99d93f5924a24967831dea363dca3b8a) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:09.445086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:09.446574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9a142-0396-4587-b795-464db16d87d3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:09.452899 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 562/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:09 2022] GET /identity/v3/role_assignments?user.id=99d93f5924a24967831dea363dca3b8a&scope.project.id=331fe15bb9af450c81f06a963a9bb640&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:11.692557 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326c4df-1e24-4b0f-939d-f50a9aa13012 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:11.693111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326c4df-1e24-4b0f-939d-f50a9aa13012 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:11.693111 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326c4df-1e24-4b0f-939d-f50a9aa13012 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:11.694503 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 545/1107] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:11.699779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:11.700175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:11.700352 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:11.717431 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:11.718627 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:11.773562 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:11.785820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 563/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:11.811130 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326c4df-1e24-4b0f-939d-f50a9aa13012 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:11.863307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:11.913071 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326c4df-1e24-4b0f-939d-f50a9aa13012 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:11.947084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbdc7f-144a-445d-adb0-3a11f0c2eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:11.947801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbdc7f-144a-445d-adb0-3a11f0c2eebc None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:11.948081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbdc7f-144a-445d-adb0-3a11f0c2eebc None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:11.948355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbdc7f-144a-445d-adb0-3a11f0c2eebc None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:11.949514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbdc7f-144a-445d-adb0-3a11f0c2eebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:11.950967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbdc7f-144a-445d-adb0-3a11f0c2eebc None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:11.952575 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 546/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:11.961163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:12.058478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa10f5-0417-4a59-bdca-26b52b30261a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:12.092658 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090e6e0-d3df-4edf-8d8a-7c010ffc163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:12.093328 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090e6e0-d3df-4edf-8d8a-7c010ffc163e None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:12.093613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090e6e0-d3df-4edf-8d8a-7c010ffc163e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:12.093893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090e6e0-d3df-4edf-8d8a-7c010ffc163e None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:12.094613 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090e6e0-d3df-4edf-8d8a-7c010ffc163e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:12.096132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090e6e0-d3df-4edf-8d8a-7c010ffc163e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:12.116082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 564/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:25:11 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:14.423592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f515-5c8b-435a-ab14-ff2827496a0b None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:14.424661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f515-5c8b-435a-ab14-ff2827496a0b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:14.424661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f515-5c8b-435a-ab14-ff2827496a0b None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:14.426048 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 547/1111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:14.431259 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:14.431643 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:14.431817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:14.448930 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:14.450108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:14.491921 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:14.517607 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 565/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:14.542052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f515-5c8b-435a-ab14-ff2827496a0b None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:14.644412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f515-5c8b-435a-ab14-ff2827496a0b None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:14.661089 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:14.677806 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:14.678598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:14.678912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:14.679192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] PATH_INFO: `/v3/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:14.680676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] RBAC: Authorizing `identity:get_role(role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:14.682042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:14.683457 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 548/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:14 2022] GET /identity/v3/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:14.689198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:14.786363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae6e8-8c7c-4d30-aaab-28fb88186771 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:14.819775 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:14.820631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:14.820916 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:14.821192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] PATH_INFO: `/v3/users/df894f4bf22f4c17a10f4c52fb66ea7f` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:14.834050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] RBAC: Authorizing `identity:get_user(user_id=df894f4bf22f4c17a10f4c52fb66ea7f)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:14.835519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:14.837143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 566/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:14 2022] GET /identity/v3/users/df894f4bf22f4c17a10f4c52fb66ea7f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:14.842675 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:14.941275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321b386-ea21-47a9-8c33-c939edf0e509 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:14.974972 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:14.975615 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:14.975903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:14.976186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:15.028654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:15.042513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:15.044007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:15.138529 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 549/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:15.144980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:15.178487 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:15.243676 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad88090-e613-4450-ad97-599a12c9bd76 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:15.276448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62313159-e228-45cb-b9e1-1f398856e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:15.277287 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313159-e228-45cb-b9e1-1f398856e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:15.277567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313159-e228-45cb-b9e1-1f398856e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:15.277839 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313159-e228-45cb-b9e1-1f398856e6b6 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:15.279022 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62313159-e228-45cb-b9e1-1f398856e6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=331fe15bb9af450c81f06a963a9bb640)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:15.280460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62313159-e228-45cb-b9e1-1f398856e6b6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:15.282143 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 567/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:15 2022] GET /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:15.288257 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:15.371152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:15.386368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a84419-d6c8-4368-9975-bfcc7d71d922 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:15.419757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:15.420402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:15.420687 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:15.420964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:15.421796 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] RBAC: Adding query filter params (role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=331fe15bb9af450c81f06a963a9bb640, user.id=df894f4bf22f4c17a10f4c52fb66ea7f) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:15.422110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:15.423559 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77371a-b2fa-408d-88cb-5954e9b21bd3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:15.429070 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 550/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:15 2022] GET /identity/v3/role_assignments?user.id=df894f4bf22f4c17a10f4c52fb66ea7f&scope.project.id=331fe15bb9af450c81f06a963a9bb640&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:17.626474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180ec3d-5459-435c-a182-75bb3633f6b9 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:17.627592 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180ec3d-5459-435c-a182-75bb3633f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:17.627701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180ec3d-5459-435c-a182-75bb3633f6b9 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:17.629037 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 568/1118] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:17.634497 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:17.634956 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:17.635217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:17.653531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:17.654705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:17.724833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 551/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:17.747777 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180ec3d-5459-435c-a182-75bb3633f6b9 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:17.849363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180ec3d-5459-435c-a182-75bb3633f6b9 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:17.851077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:17.885094 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:17.885880 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:17.886163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:17.886441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] PATH_INFO: `/v3/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:17.887960 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] RBAC: Authorizing `identity:get_role(role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:17.889346 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:17.890746 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 569/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:17 2022] GET /identity/v3/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:17.896664 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:17.975660 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:17.998196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7484-399d-494a-89fc-fdd4ca22a993 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:18.032591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:18.033504 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:18.033783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:18.034053 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] PATH_INFO: `/v3/users/df894f4bf22f4c17a10f4c52fb66ea7f` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:18.035250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] RBAC: Authorizing `identity:get_user(user_id=df894f4bf22f4c17a10f4c52fb66ea7f)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:18.036670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:18.038292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 552/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:17 2022] GET /identity/v3/users/df894f4bf22f4c17a10f4c52fb66ea7f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:18.044018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:18.142065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66678-91cd-486b-856e-e1cfb891ae2b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:18.174987 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766cbfb-72e5-49f4-91eb-f145181b9a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:18.175830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766cbfb-72e5-49f4-91eb-f145181b9a91 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:18.176109 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766cbfb-72e5-49f4-91eb-f145181b9a91 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:18.176382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766cbfb-72e5-49f4-91eb-f145181b9a91 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:18.177552 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766cbfb-72e5-49f4-91eb-f145181b9a91 None admin] RBAC: Authorizing `identity:get_project(project_id=331fe15bb9af450c81f06a963a9bb640)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:18.179019 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766cbfb-72e5-49f4-91eb-f145181b9a91 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:18.180705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 570/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:18 2022] GET /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:18.186410 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:18.282169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734fe3-0245-4b41-9a64-871dd48595a3 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:18.316228 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f6eef-0f0c-4847-837b-14b16436bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:18.317108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f6eef-0f0c-4847-837b-14b16436bc30 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:18.317397 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f6eef-0f0c-4847-837b-14b16436bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:18.317678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f6eef-0f0c-4847-837b-14b16436bc30 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640/users/df894f4bf22f4c17a10f4c52fb66ea7f/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:18.319913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f6eef-0f0c-4847-837b-14b16436bc30 None admin] RBAC: Authorizing `identity:create_grant(project_id=331fe15bb9af450c81f06a963a9bb640, user_id=df894f4bf22f4c17a10f4c52fb66ea7f, role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:18.321335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f6eef-0f0c-4847-837b-14b16436bc30 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:18.334131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 553/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:25:18 2022] PUT /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640/users/df894f4bf22f4c17a10f4c52fb66ea7f/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:25:20.546660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af5ac-49d1-47f9-a73a-8393fd5d6071 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:20.547226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af5ac-49d1-47f9-a73a-8393fd5d6071 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:20.547226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af5ac-49d1-47f9-a73a-8393fd5d6071 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:20.549138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 571/1124] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:20.554249 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:20.554656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:20.554813 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:20.572091 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:20.573261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:20.575227 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:20.640929 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 554/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:20.664952 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af5ac-49d1-47f9-a73a-8393fd5d6071 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:20.706336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:20.765845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af5ac-49d1-47f9-a73a-8393fd5d6071 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:20.799406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:20.800194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:20.800478 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:20.800753 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] PATH_INFO: `/v3/roles/7f1803f3d13e4f819d0b6a83ac854bb0` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:20.802229 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] RBAC: Authorizing `identity:get_role(role_id=7f1803f3d13e4f819d0b6a83ac854bb0)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:20.803645 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:20.805019 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 572/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:20 2022] GET /identity/v3/roles/7f1803f3d13e4f819d0b6a83ac854bb0 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:20.810697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:20.910041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae7511-a71a-4901-83e9-d95ef27b9b03 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:20.942927 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:20.943794 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:20.944077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:20.944354 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] PATH_INFO: `/v3/users/df894f4bf22f4c17a10f4c52fb66ea7f` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:20.945536 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] RBAC: Authorizing `identity:get_user(user_id=df894f4bf22f4c17a10f4c52fb66ea7f)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:20.946994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:20.948622 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 555/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:20 2022] GET /identity/v3/users/df894f4bf22f4c17a10f4c52fb66ea7f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:20.954537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:21.051809 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe57dc-fbcc-43e4-96fb-ce35b0b459bc None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:21.058861 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:21.085945 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:21.086586 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:21.086900 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:21.087184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:21.152324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:21.153781 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:21.250649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 573/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:21.257035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:21.265635 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:21.354281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b1b3-2986-4fef-919d-c2f69450ca5d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:21.387544 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2940-dcdc-4fb7-84fd-a2afc3b40a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:21.388389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2940-dcdc-4fb7-84fd-a2afc3b40a43 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:21.388673 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2940-dcdc-4fb7-84fd-a2afc3b40a43 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:21.388948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2940-dcdc-4fb7-84fd-a2afc3b40a43 None admin] PATH_INFO: `/v3/projects/331fe15bb9af450c81f06a963a9bb640` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:21.390122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2940-dcdc-4fb7-84fd-a2afc3b40a43 None admin] RBAC: Authorizing `identity:get_project(project_id=331fe15bb9af450c81f06a963a9bb640)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:21.391585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2940-dcdc-4fb7-84fd-a2afc3b40a43 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:21.393305 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 556/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:21 2022] GET /identity/v3/projects/331fe15bb9af450c81f06a963a9bb640 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:21.399368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:21.407377 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:21.498178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd34f3-e679-4fe3-b20c-f74d076bad18 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:21.530806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:21.531457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:21.531742 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:21.532018 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:21.533366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] RBAC: Adding query filter params (role.id=7f1803f3d13e4f819d0b6a83ac854bb0, scope.project.id=331fe15bb9af450c81f06a963a9bb640, user.id=df894f4bf22f4c17a10f4c52fb66ea7f) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:21.533688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:21.535157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f219af8-2f88-436e-8a62-e46ac3bd8a56 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:21.541736 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 574/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:21 2022] GET /identity/v3/role_assignments?user.id=df894f4bf22f4c17a10f4c52fb66ea7f&scope.project.id=331fe15bb9af450c81f06a963a9bb640&role.id=7f1803f3d13e4f819d0b6a83ac854bb0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:23.767487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cac3d-3781-42dd-a7cf-0b38849289e1 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:23.768025 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cac3d-3781-42dd-a7cf-0b38849289e1 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:23.768025 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cac3d-3781-42dd-a7cf-0b38849289e1 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:23.769411 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 557/1131] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:23.774573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:23.774981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:23.775167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:23.792157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:23.793329 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:23.854121 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:23.859421 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 575/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:23.884081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cac3d-3781-42dd-a7cf-0b38849289e1 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:23.992002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cac3d-3781-42dd-a7cf-0b38849289e1 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:24.024865 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba833e5-0ecf-49fb-a8ec-d18f0bd2b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:24.025588 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba833e5-0ecf-49fb-a8ec-d18f0bd2b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:24.025869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba833e5-0ecf-49fb-a8ec-d18f0bd2b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:24.026142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba833e5-0ecf-49fb-a8ec-d18f0bd2b6d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:24.027337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba833e5-0ecf-49fb-a8ec-d18f0bd2b6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:24.028767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba833e5-0ecf-49fb-a8ec-d18f0bd2b6d4 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:24.030381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 558/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:24.036271 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:24.134364 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dcf15-b88d-4222-a936-cac0f17cc518 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:24.167065 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61ce3-26e8-439a-92c3-e2d5779ed1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:24.167717 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61ce3-26e8-439a-92c3-e2d5779ed1b7 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:24.168004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61ce3-26e8-439a-92c3-e2d5779ed1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:24.168282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61ce3-26e8-439a-92c3-e2d5779ed1b7 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:24.168998 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61ce3-26e8-439a-92c3-e2d5779ed1b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:24.170441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61ce3-26e8-439a-92c3-e2d5779ed1b7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:24.196550 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 576/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:25:24 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:26.416999 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd63f-33c8-4e86-806d-bf1f720a17e9 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:26.417665 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd63f-33c8-4e86-806d-bf1f720a17e9 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:26.417665 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd63f-33c8-4e86-806d-bf1f720a17e9 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:26.418935 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 559/1135] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:26.424663 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:26.425061 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:26.425223 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:26.442429 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:26.443637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:26.489286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:26.510641 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 577/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:26.536337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd63f-33c8-4e86-806d-bf1f720a17e9 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:26.638313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd63f-33c8-4e86-806d-bf1f720a17e9 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:26.673075 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7ca27-7916-4fe8-84b5-04a9b1f29dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:26.673825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ca27-7916-4fe8-84b5-04a9b1f29dae None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:26.674113 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ca27-7916-4fe8-84b5-04a9b1f29dae None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:26.674394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ca27-7916-4fe8-84b5-04a9b1f29dae None admin] PATH_INFO: `/v3/domains/default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:26.675610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ca27-7916-4fe8-84b5-04a9b1f29dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:26.677045 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ca27-7916-4fe8-84b5-04a9b1f29dae None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:26.678680 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 560/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:25:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:26.684369 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:26.781106 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b84e3-1a74-440b-9fb3-de85f1f53051 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:26.813266 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa54ec0-8ee0-4c4e-ac22-ffee1ccd3ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:26.814468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54ec0-8ee0-4c4e-ac22-ffee1ccd3ea4 None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:26.814752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54ec0-8ee0-4c4e-ac22-ffee1ccd3ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:26.815055 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54ec0-8ee0-4c4e-ac22-ffee1ccd3ea4 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:26.815768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa54ec0-8ee0-4c4e-ac22-ffee1ccd3ea4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:26.817212 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa54ec0-8ee0-4c4e-ac22-ffee1ccd3ea4 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:26.837338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 578/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:25:26 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:29.078164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224b82-01fb-4c60-9e65-3266b4d01939 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:29.078713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224b82-01fb-4c60-9e65-3266b4d01939 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:29.078713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224b82-01fb-4c60-9e65-3266b4d01939 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:29.080233 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 561/1139] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:29.085523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:29.085935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:29.086079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:29.103250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:29.104359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:29.133606 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:29.171696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 579/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:29.195125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224b82-01fb-4c60-9e65-3266b4d01939 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:29.207989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:29.300372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224b82-01fb-4c60-9e65-3266b4d01939 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:29.333376 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:29.334161 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:29.334446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:29.334725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:29.344634 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:29.352939 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:29.354004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:29.354842 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 562/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:29.360175 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:29.456727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2d84-41cb-477a-90bf-52ac04e20561 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:29.489249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:29.489894 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:29.490176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:29.490448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:29.491214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:29.491519 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:29.492892 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:29.500934 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 580/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:29.507152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:29.575407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:29.607596 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb4169-9568-4c7e-8933-ba6cfaf770ea None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:29.640468 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e68139-e80c-456a-99c7-295187787877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:29.641334 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e68139-e80c-456a-99c7-295187787877 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:29.641619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e68139-e80c-456a-99c7-295187787877 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:29.642449 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e68139-e80c-456a-99c7-295187787877 None admin] PATH_INFO: `/v3/users/5ed1b3eb7e7b449589ada087430a41f0` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:29.655270 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e68139-e80c-456a-99c7-295187787877 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed1b3eb7e7b449589ada087430a41f0)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:29.656713 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e68139-e80c-456a-99c7-295187787877 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:29.658400 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 563/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:29 2022] GET /identity/v3/users/5ed1b3eb7e7b449589ada087430a41f0 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:29.664339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:29.694902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:29.762358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c2a4f-aec8-4656-a737-4bf8c8d2af87 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:29.794873 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:29.795507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:29.795787 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:29.796062 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:29.861838 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:29.863278 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:29.891726 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:29.960806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 581/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:29.966805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e68139-e80c-456a-99c7-295187787877 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:30.065054 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e68139-e80c-456a-99c7-295187787877 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:30.090764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:30.099219 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96190408-b61d-491c-a40a-9d1bafa1ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:30.100076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96190408-b61d-491c-a40a-9d1bafa1ac3b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:30.100358 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96190408-b61d-491c-a40a-9d1bafa1ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:30.100635 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96190408-b61d-491c-a40a-9d1bafa1ac3b None admin] PATH_INFO: `/v3/projects/f9c74e06fe304765a8d0d22795ecccfd` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:30.101807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96190408-b61d-491c-a40a-9d1bafa1ac3b None admin] RBAC: Authorizing `identity:get_project(project_id=f9c74e06fe304765a8d0d22795ecccfd)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:30.103277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96190408-b61d-491c-a40a-9d1bafa1ac3b None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:30.104969 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 564/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:29 2022] GET /identity/v3/projects/f9c74e06fe304765a8d0d22795ecccfd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:30.111241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:30.210197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99175a77-2c32-4b77-acaa-49daeed94599 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:30.238849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:30.245069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:30.245713 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:30.245996 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:30.246272 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:30.247130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=f9c74e06fe304765a8d0d22795ecccfd, user.id=5ed1b3eb7e7b449589ada087430a41f0) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:30.247444 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:30.248882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e685a-3b2c-4a97-a08e-c0a5d57ea032 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:30.254898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 582/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:30 2022] GET /identity/v3/role_assignments?user.id=5ed1b3eb7e7b449589ada087430a41f0&scope.project.id=f9c74e06fe304765a8d0d22795ecccfd&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:32.426049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133da9a-2eb8-4f11-8447-68b5da253e02 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:32.426583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133da9a-2eb8-4f11-8447-68b5da253e02 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:32.426583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133da9a-2eb8-4f11-8447-68b5da253e02 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:32.428020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 565/1147] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:32.433328 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:32.433738 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:32.433896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:32.451101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:32.452286 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:32.517450 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 583/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:32.539345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133da9a-2eb8-4f11-8447-68b5da253e02 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:32.643423 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133da9a-2eb8-4f11-8447-68b5da253e02 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:32.677276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:32.677995 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:32.678275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:32.678548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:32.688339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:32.695858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:32.696893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:32.697875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 566/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:32.703138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:32.800449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf132d8-77df-4052-9d5a-d365de5966be None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:32.823247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:32.834779 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:32.835465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:32.835749 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:32.836026 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:32.836766 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:32.837072 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:32.838449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:32.846867 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 584/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:32.852594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:32.909199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:32.954706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f7669-80f4-4160-814b-25b7c8d7851f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:32.987695 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:32.988559 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:32.988843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:32.989121 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] PATH_INFO: `/v3/users/5ed1b3eb7e7b449589ada087430a41f0` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:32.990297 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed1b3eb7e7b449589ada087430a41f0)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:32.991782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:32.993415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 567/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:32 2022] GET /identity/v3/users/5ed1b3eb7e7b449589ada087430a41f0 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:32.999477 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:33.097196 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8221c-49d7-406d-980c-a395d0f9d565 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:33.134380 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb51a2-331c-40db-94d5-a0f850c9ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:33.135320 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb51a2-331c-40db-94d5-a0f850c9ac94 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:33.135604 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb51a2-331c-40db-94d5-a0f850c9ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:33.135879 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb51a2-331c-40db-94d5-a0f850c9ac94 None admin] PATH_INFO: `/v3/projects/f9c74e06fe304765a8d0d22795ecccfd` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:33.137047 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb51a2-331c-40db-94d5-a0f850c9ac94 None admin] RBAC: Authorizing `identity:get_project(project_id=f9c74e06fe304765a8d0d22795ecccfd)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:33.138527 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb51a2-331c-40db-94d5-a0f850c9ac94 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:33.140249 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 585/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:32 2022] GET /identity/v3/projects/f9c74e06fe304765a8d0d22795ecccfd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:33.146578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:33.244060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f30b2-1cdf-4912-aa16-3ae701d44a94 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:33.266366 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:33.277676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a0488-f433-4ca8-8142-4473ab6af7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:33.278555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a0488-f433-4ca8-8142-4473ab6af7ac None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:33.278867 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a0488-f433-4ca8-8142-4473ab6af7ac None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:33.279144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a0488-f433-4ca8-8142-4473ab6af7ac None admin] PATH_INFO: `/v3/projects/f9c74e06fe304765a8d0d22795ecccfd/users/5ed1b3eb7e7b449589ada087430a41f0/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:33.281076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a0488-f433-4ca8-8142-4473ab6af7ac None admin] RBAC: Authorizing `identity:create_grant(project_id=f9c74e06fe304765a8d0d22795ecccfd, user_id=5ed1b3eb7e7b449589ada087430a41f0, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:33.283135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a0488-f433-4ca8-8142-4473ab6af7ac None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:33.296340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 568/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:25:33 2022] PUT /identity/v3/projects/f9c74e06fe304765a8d0d22795ecccfd/users/5ed1b3eb7e7b449589ada087430a41f0/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:25:35.517599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223066da-c4c6-4227-a0ef-6e235ea45755 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:35.518154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223066da-c4c6-4227-a0ef-6e235ea45755 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:35.518154 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223066da-c4c6-4227-a0ef-6e235ea45755 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:35.519575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 586/1154] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:35.524807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:35.525243 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:35.525351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:35.541838 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:35.543034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:35.609498 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 569/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:25:35.634185 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223066da-c4c6-4227-a0ef-6e235ea45755 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:35.696004 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:35.742277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223066da-c4c6-4227-a0ef-6e235ea45755 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:35.777133 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:35.777862 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:35.778150 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:35.778428 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:35.789112 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:35.796800 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:35.798536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:35.799404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 587/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:35.804770 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:35.902447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3908-4a9d-4dd3-895a-40515339be65 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:35.916306 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:35.936424 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:35.937095 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:35.937382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:35.937663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:35.938948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:35.939260 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:35.940624 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:35.948500 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 570/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:35.954990 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:36.061023 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5a4d-a913-4b48-a949-80732d46ad3f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:36.074667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:36.094544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:36.095449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:36.095733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:36.096011 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] PATH_INFO: `/v3/users/5ed1b3eb7e7b449589ada087430a41f0` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:36.097198 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] RBAC: Authorizing `identity:get_user(user_id=5ed1b3eb7e7b449589ada087430a41f0)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:36.098656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:36.100336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 588/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:35 2022] GET /identity/v3/users/5ed1b3eb7e7b449589ada087430a41f0 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:36.106180 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:36.204728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98910-6b1c-40bc-bb22-f941579be602 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:36.239965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:36.240619 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:36.240908 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:36.241192 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:36.285599 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:36.307928 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:36.309390 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:36.407893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 571/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:36.413709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:36.512240 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec39e-fa19-49a9-953a-2927215c3d6c None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:36.544396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5a47a-f896-45c3-ab9c-bdb8aea9b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:36.545252 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5a47a-f896-45c3-ab9c-bdb8aea9b019 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:36.545536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5a47a-f896-45c3-ab9c-bdb8aea9b019 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:36.545813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5a47a-f896-45c3-ab9c-bdb8aea9b019 None admin] PATH_INFO: `/v3/projects/f9c74e06fe304765a8d0d22795ecccfd` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:36.547006 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5a47a-f896-45c3-ab9c-bdb8aea9b019 None admin] RBAC: Authorizing `identity:get_project(project_id=f9c74e06fe304765a8d0d22795ecccfd)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:36.549077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5a47a-f896-45c3-ab9c-bdb8aea9b019 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:36.550758 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 589/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:36 2022] GET /identity/v3/projects/f9c74e06fe304765a8d0d22795ecccfd => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:36.556777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:36.631404 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:36.654013 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53f0b-c03e-486d-a624-42a813bb199e None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:36.689064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:36.689719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:36.690005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:36.690282 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:36.691156 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=f9c74e06fe304765a8d0d22795ecccfd, user.id=5ed1b3eb7e7b449589ada087430a41f0) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:36.691472 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:36.692893 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da82de3-aea0-471d-b5df-710d5035a4e0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:36.698705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 572/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:36 2022] GET /identity/v3/role_assignments?user.id=5ed1b3eb7e7b449589ada087430a41f0&scope.project.id=f9c74e06fe304765a8d0d22795ecccfd&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:38.913248 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cce5d7-d043-4a28-8e33-8f05df015021 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:38.913765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cce5d7-d043-4a28-8e33-8f05df015021 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:38.913872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cce5d7-d043-4a28-8e33-8f05df015021 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:38.915228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 590/1162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:38.920449 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:38.920849 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:38.921002 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:38.937357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:38.939067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:39.004022 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 573/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:25:39.025958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cce5d7-d043-4a28-8e33-8f05df015021 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:39.076605 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:39.129041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cce5d7-d043-4a28-8e33-8f05df015021 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:39.161849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:39.162496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:39.162811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:39.163099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:39.229792 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:39.231293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:39.278266 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:39.327845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 591/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:39.334392 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:39.410377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:39.440395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2bd2-bd20-47b1-a99f-d57e254e59bc None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:39.472996 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:39.473791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:39.474073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:39.474348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:39.480860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:39.482288 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-c996ce18-f716-4769-9e0d-2a8f8a246eba None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:39.496386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:39.497600 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:39.498465 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 574/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:25:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:39.504115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:39.601123 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a815a-44de-4e83-95e6-676be7247706 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:39.634145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:39.634813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:39.635101 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:39.635374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:39.636083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:39.636386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:39.637752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b363-e259-4e33-b840-b929db953028 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:39.644742 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 592/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:25:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:41.835256 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9019a-1a9e-4f46-bf48-6ffdf01a07cd None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:41.835824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9019a-1a9e-4f46-bf48-6ffdf01a07cd None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:41.835824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9019a-1a9e-4f46-bf48-6ffdf01a07cd None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:41.837189 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 575/1167] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:41.842401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b914ae-106a-4165-b966-66c8e2f656a1 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:41.842874 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b914ae-106a-4165-b966-66c8e2f656a1 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:41.842982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b914ae-106a-4165-b966-66c8e2f656a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:41.860802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-b5b914ae-106a-4165-b966-66c8e2f656a1 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:41.861976 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-b5b914ae-106a-4165-b966-66c8e2f656a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:41.871296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:41.928382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 593/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:41.951438 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9019a-1a9e-4f46-bf48-6ffdf01a07cd None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:42.053383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9019a-1a9e-4f46-bf48-6ffdf01a07cd None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:42.081698 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:42.087860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4bb9-c48a-4a6c-b13c-f38a3e2cb956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:42.088457 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4bb9-c48a-4a6c-b13c-f38a3e2cb956 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:42.088738 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4bb9-c48a-4a6c-b13c-f38a3e2cb956 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:42.089041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4bb9-c48a-4a6c-b13c-f38a3e2cb956 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:42.089776 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc4bb9-c48a-4a6c-b13c-f38a3e2cb956 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:42.091165 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc4bb9-c48a-4a6c-b13c-f38a3e2cb956 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:42.105139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 576/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Thu May 19 14:25:41 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:44.334016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f1634-8284-4d43-a69a-c0ec4693c5a5 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:44.334572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f1634-8284-4d43-a69a-c0ec4693c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:44.334572 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f1634-8284-4d43-a69a-c0ec4693c5a5 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:44.336097 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 594/1170] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:44.341466 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:44.341881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:44.342029 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:44.358662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:44.360396 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:44.432606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 577/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:44.457209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f1634-8284-4d43-a69a-c0ec4693c5a5 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:44.556730 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f1634-8284-4d43-a69a-c0ec4693c5a5 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:44.589935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a404515-f97a-4e2b-840b-95792be5dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:44.590718 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404515-f97a-4e2b-840b-95792be5dd59 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:44.591151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404515-f97a-4e2b-840b-95792be5dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:44.591436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404515-f97a-4e2b-840b-95792be5dd59 None admin] PATH_INFO: `/v3/domains/3130c91df4334ad0a8efd90eef376fe9` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:44.602203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a404515-f97a-4e2b-840b-95792be5dd59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3130c91df4334ad0a8efd90eef376fe9)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:44.603694 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a404515-f97a-4e2b-840b-95792be5dd59 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:44.605330 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 595/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:25:44 2022] GET /identity/v3/domains/3130c91df4334ad0a8efd90eef376fe9 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:44.611308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:44.710395 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d655-a4ea-4e83-b803-50f514b2aa58 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:44.729620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:44.744076 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3409c-26f7-4058-8d07-09c1af0e07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:44.744735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3409c-26f7-4058-8d07-09c1af0e07e7 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:44.745018 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3409c-26f7-4058-8d07-09c1af0e07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:44.745296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3409c-26f7-4058-8d07-09c1af0e07e7 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:44.746004 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3409c-26f7-4058-8d07-09c1af0e07e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:44.747474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3409c-26f7-4058-8d07-09c1af0e07e7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:44.772896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 578/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:25:44 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:47.009571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9120b-bf22-4963-8571-b06f429a0d49 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:47.010114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9120b-bf22-4963-8571-b06f429a0d49 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:47.010114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9120b-bf22-4963-8571-b06f429a0d49 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:47.011661 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 596/1174] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:47.017011 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:47.017398 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:47.017575 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:47.034681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:47.035901 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:47.102230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 579/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:47.127840 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9120b-bf22-4963-8571-b06f429a0d49 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:47.131628 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:47.228276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9120b-bf22-4963-8571-b06f429a0d49 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:47.262542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c855fd-d54a-4305-900c-3258a9cba0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:47.263423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c855fd-d54a-4305-900c-3258a9cba0b9 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:47.263711 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c855fd-d54a-4305-900c-3258a9cba0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:47.263989 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c855fd-d54a-4305-900c-3258a9cba0b9 None admin] PATH_INFO: `/v3/domains/3130c91df4334ad0a8efd90eef376fe9` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:47.265170 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c855fd-d54a-4305-900c-3258a9cba0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3130c91df4334ad0a8efd90eef376fe9)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:47.266649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c855fd-d54a-4305-900c-3258a9cba0b9 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:47.268297 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 597/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:25:47 2022] GET /identity/v3/domains/3130c91df4334ad0a8efd90eef376fe9 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:47.273952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:47.373345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bff90c-ac32-40de-869a-6419b06113b8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:47.374780 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:47.408632 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe9b0-603e-4ebc-a57e-bf3318c28cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:47.409309 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe9b0-603e-4ebc-a57e-bf3318c28cf5 None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:47.409598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe9b0-603e-4ebc-a57e-bf3318c28cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:47.409879 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe9b0-603e-4ebc-a57e-bf3318c28cf5 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:47.410587 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe9b0-603e-4ebc-a57e-bf3318c28cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:47.412060 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe9b0-603e-4ebc-a57e-bf3318c28cf5 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:47.432548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 580/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:25:47 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:25:49.702145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6aec4-ffa8-4cb2-a16c-5cbbd47eef70 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:49.702714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6aec4-ffa8-4cb2-a16c-5cbbd47eef70 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:49.702714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6aec4-ffa8-4cb2-a16c-5cbbd47eef70 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:49.704624 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 598/1178] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:49.710055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:49.710457 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:49.710617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:49.735715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:49.737034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:49.804784 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 581/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:49.827750 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6aec4-ffa8-4cb2-a16c-5cbbd47eef70 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:49.899833 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:49.929760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6aec4-ffa8-4cb2-a16c-5cbbd47eef70 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:49.963659 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:49.964394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:49.964680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:49.964961 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:49.975458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:49.983041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:49.984076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:49.985577 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 599/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:49.990875 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:50.083719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:50.097405 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40ea36-f3b4-4ef4-a2db-284dd2e47ef8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:50.130796 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:50.131475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:50.131757 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:50.132035 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:50.132781 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:50.133087 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:50.134448 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:50.142374 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 582/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:50.148195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:50.248243 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ed07b-46b4-4f80-8158-91b196222c98 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:50.277651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:50.283620 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:50.284489 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:50.284773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:50.285051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] PATH_INFO: `/v3/users/832957df2fcc4171aacae06feae3c955` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:50.298836 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] RBAC: Authorizing `identity:get_user(user_id=832957df2fcc4171aacae06feae3c955)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:50.300288 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:50.301968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 600/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:50 2022] GET /identity/v3/users/832957df2fcc4171aacae06feae3c955 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:50.307834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:50.430629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbca5-8e1f-4fb5-9921-0aab0423f177 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:50.467031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:50.467679 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:50.467958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:50.468229 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:50.488285 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:50.536444 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:50.537824 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:50.645467 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 583/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:50.651415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:50.778051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0850-de85-4219-90be-206b94da4276 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:50.816616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816820a-f9e0-4214-9166-ddceacf1e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:50.817399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816820a-f9e0-4214-9166-ddceacf1e833 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:50.817681 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816820a-f9e0-4214-9166-ddceacf1e833 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:50.817958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816820a-f9e0-4214-9166-ddceacf1e833 None admin] PATH_INFO: `/v3/projects/d643a2545a0743a8822ab715a6f769c7` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:50.819164 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816820a-f9e0-4214-9166-ddceacf1e833 None admin] RBAC: Authorizing `identity:get_project(project_id=d643a2545a0743a8822ab715a6f769c7)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:50.820615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816820a-f9e0-4214-9166-ddceacf1e833 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:50.822331 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 601/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:50 2022] GET /identity/v3/projects/d643a2545a0743a8822ab715a6f769c7 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:50.829193 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:50.880653 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:50.930260 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cd10-ed3b-450c-b3a5-6ff97fdeb662 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:50.963186 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:50.963848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:50.964136 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:50.964418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:50.965277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=d643a2545a0743a8822ab715a6f769c7, user.id=832957df2fcc4171aacae06feae3c955) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:50.965593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:50.967034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffda903-7063-417a-85f2-bcb7d36c8702 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:50.973063 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 584/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:50 2022] GET /identity/v3/role_assignments?user.id=832957df2fcc4171aacae06feae3c955&scope.project.id=d643a2545a0743a8822ab715a6f769c7&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:53.153991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58544a-8a9f-475e-bdb1-1533d6b1ba98 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:53.154501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58544a-8a9f-475e-bdb1-1533d6b1ba98 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:53.154501 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58544a-8a9f-475e-bdb1-1533d6b1ba98 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:53.155983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 602/1186] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:53.162144 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:53.162594 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:53.162691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:53.179124 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:53.180303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:53.244803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 585/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:53.267374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58544a-8a9f-475e-bdb1-1533d6b1ba98 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:53.325646 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:53.368481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58544a-8a9f-475e-bdb1-1533d6b1ba98 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:53.401442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:53.402221 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:53.402508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:53.402782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:53.412913 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:53.420494 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:53.422156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:25:53.423339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 603/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:53.428199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:53.472684 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:53.525551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3438d9-e4bf-4837-9df6-a00055df3d53 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:53.558079 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:53.558739 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:53.559049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:53.559325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:53.560067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:53.560373 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:53.561723 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:53.570140 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 586/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:53.575948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:53.675402 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dc6b3-9e14-4892-8727-32188ededfbf None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:53.691756 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:53.708176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:53.709036 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:53.709319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:53.709595 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] PATH_INFO: `/v3/users/832957df2fcc4171aacae06feae3c955` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:53.710813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] RBAC: Authorizing `identity:get_user(user_id=832957df2fcc4171aacae06feae3c955)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:53.712275 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:53.713906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 604/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:53 2022] GET /identity/v3/users/832957df2fcc4171aacae06feae3c955 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:53.720201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:53.818537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a346-9c67-454c-b975-63773d1f43bd None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:53.825430 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:53.852580 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c120-23fd-4941-8afe-96a685b94a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:53.853447 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c120-23fd-4941-8afe-96a685b94a9d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:53.853730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c120-23fd-4941-8afe-96a685b94a9d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:53.854003 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c120-23fd-4941-8afe-96a685b94a9d None admin] PATH_INFO: `/v3/projects/d643a2545a0743a8822ab715a6f769c7` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:53.855211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789c120-23fd-4941-8afe-96a685b94a9d None admin] RBAC: Authorizing `identity:get_project(project_id=d643a2545a0743a8822ab715a6f769c7)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:53.856650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789c120-23fd-4941-8afe-96a685b94a9d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:53.858377 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 587/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:53 2022] GET /identity/v3/projects/d643a2545a0743a8822ab715a6f769c7 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:53.865051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:53.966110 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732ae6-197c-49cc-b14c-cd69a67bca3d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:53.999156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab6d6e-eb04-4314-8fa9-e7c0f1646fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:54.000765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6d6e-eb04-4314-8fa9-e7c0f1646fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:54.001045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6d6e-eb04-4314-8fa9-e7c0f1646fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:54.001321 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6d6e-eb04-4314-8fa9-e7c0f1646fd6 None admin] PATH_INFO: `/v3/projects/d643a2545a0743a8822ab715a6f769c7/users/832957df2fcc4171aacae06feae3c955/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:54.003318 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab6d6e-eb04-4314-8fa9-e7c0f1646fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d643a2545a0743a8822ab715a6f769c7, user_id=832957df2fcc4171aacae06feae3c955, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:54.004770 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab6d6e-eb04-4314-8fa9-e7c0f1646fd6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:54.017598 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 605/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:25:53 2022] PUT /identity/v3/projects/d643a2545a0743a8822ab715a6f769c7/users/832957df2fcc4171aacae06feae3c955/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:25:56.209319 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a794f67-d1dd-44e2-be3c-a1d5c53ce8ac None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:56.209868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a794f67-d1dd-44e2-be3c-a1d5c53ce8ac None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:56.209868 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a794f67-d1dd-44e2-be3c-a1d5c53ce8ac None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:56.211298 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 588/1193] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:25:56.216651 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:56.217068 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:56.217209 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:56.234443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:25:56.235542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:25:56.277610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:56.302575 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 606/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:25:56.326049 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a794f67-d1dd-44e2-be3c-a1d5c53ce8ac None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:56.428375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a794f67-d1dd-44e2-be3c-a1d5c53ce8ac None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:56.460751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:56.461476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:56.461758 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:56.462034 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:56.472961 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:25:56.480492 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:25:56.481523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:25:56.482531 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 589/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:25:56.487701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:56.584768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6ae1-6057-4d70-85db-f2bd06820d7e None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:56.617574 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:56.618484 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:56.618765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:56.619073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:56.619815 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:56.620121 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:56.621504 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:56.630463 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 607/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:56.636269 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:56.669848 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:56.735537 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f90ae3-bf34-4308-a9bd-e0cdbdb6086b None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:56.767653 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:56.768502 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:56.768782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:56.769055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] PATH_INFO: `/v3/users/832957df2fcc4171aacae06feae3c955` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:56.770218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] RBAC: Authorizing `identity:get_user(user_id=832957df2fcc4171aacae06feae3c955)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:56.771672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:56.773284 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 590/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:25:56 2022] GET /identity/v3/users/832957df2fcc4171aacae06feae3c955 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:56.778944 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:56.818400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:56.878110 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3008-a0b7-4da9-8f29-6d0497eacf0a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:56.911307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:56.911946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:56.912235 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:56.912509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:56.978368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:56.979863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:57.017193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:57.081423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 608/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:25:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:25:57.087549 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:57.183426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b2b64-6914-4e53-a40e-b28eee03b3ae None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:57.184915 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:25:57.216881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271e30-e9ba-4e39-9cac-132893496f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:57.217729 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271e30-e9ba-4e39-9cac-132893496f3d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:57.218009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271e30-e9ba-4e39-9cac-132893496f3d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:57.218311 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271e30-e9ba-4e39-9cac-132893496f3d None admin] PATH_INFO: `/v3/projects/d643a2545a0743a8822ab715a6f769c7` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:57.219743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48271e30-e9ba-4e39-9cac-132893496f3d None admin] RBAC: Authorizing `identity:get_project(project_id=d643a2545a0743a8822ab715a6f769c7)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:57.221179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48271e30-e9ba-4e39-9cac-132893496f3d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:57.222907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 591/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:25:57 2022] GET /identity/v3/projects/d643a2545a0743a8822ab715a6f769c7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:25:57.228923 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:25:57.327135 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd53a-f3fd-46f7-831b-b76cf6418fff None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:25:57.360244 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:25:57.360893 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:25:57.361178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:25:57.361457 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:25:57.362284 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=d643a2545a0743a8822ab715a6f769c7, user.id=832957df2fcc4171aacae06feae3c955) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:25:57.362600 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:25:57.364073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d61d-e936-4880-b346-03036bce6960 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:25:57.370041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 609/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:25:57 2022] GET /identity/v3/role_assignments?user.id=832957df2fcc4171aacae06feae3c955&scope.project.id=d643a2545a0743a8822ab715a6f769c7&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:26:07.212864 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=15 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:07.367396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:55.672252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec8479-f023-4164-ba5f-546fa7c8fb1f None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:55.672829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec8479-f023-4164-ba5f-546fa7c8fb1f None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:55.672829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec8479-f023-4164-ba5f-546fa7c8fb1f None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:55.674528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 592/1201] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:26:55.679900 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:55.680343 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:55.680533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:55.699870 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:26:55.701098 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:26:55.786975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 610/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:26:55.810612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec8479-f023-4164-ba5f-546fa7c8fb1f None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:55.935547 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec8479-f023-4164-ba5f-546fa7c8fb1f None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:55.970391 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:55.971218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:55.971498 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:55.971777 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:55.983015 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:26:55.984459 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:26:56.002155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:26:56.003302 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:26:56.004402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:26:56.004402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:26:56.004402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:26:56.004402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:26:56.004402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 593/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:26:56.009404 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:56.116832 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622670a9-6f10-48a6-9067-e1c812d0cdca None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:56.147879 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:56.155397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:56.156071 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:56.156358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:56.156637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:56.157361 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:26:56.157671 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:26:56.159079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a545d-d0f5-41b5-99c0-939dfea86de2 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:26:56.170610 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 611/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:26:56.176340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:56.238745 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:56.311206 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138150-4e58-4b54-ae6e-ef6a89549ee8 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:56.354514 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3d11-d3c2-46cc-909b-b227eee7cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:56.355896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3d11-d3c2-46cc-909b-b227eee7cd6e None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:56.356140 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3d11-d3c2-46cc-909b-b227eee7cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:56.356443 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3d11-d3c2-46cc-909b-b227eee7cd6e None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:56.357350 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa3d11-d3c2-46cc-909b-b227eee7cd6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:26:56.359091 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa3d11-d3c2-46cc-909b-b227eee7cd6e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:26:56.386176 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 594/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:26:56 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:26:58.949274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136fea3-aed0-4166-a6a8-f9feed025fbd None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:58.949853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136fea3-aed0-4166-a6a8-f9feed025fbd None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:58.949853 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136fea3-aed0-4166-a6a8-f9feed025fbd None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:58.951282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 612/1206] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:26:58.957884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:58.958363 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:58.958449 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:58.977759 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:26:58.979017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:26:59.055484 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 595/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:26:59.081672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136fea3-aed0-4166-a6a8-f9feed025fbd None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:59.208532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136fea3-aed0-4166-a6a8-f9feed025fbd None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:59.250704 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:59.251536 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:59.251825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:59.252102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:59.266802 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:26:59.275397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:26:59.276393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:26:59.277293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:26:59.281425 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 613/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:26:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:26:59.282943 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:59.327136 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:59.400225 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d96f6-1502-4c22-9312-bed31a3602b5 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:59.440125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:59.440830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:59.441081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:59.441357 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:59.442122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:26:59.442487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:26:59.443815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:26:59.457313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 596/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:26:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:26:59.462564 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:59.518632 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:59.584452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a885a5-081f-4af1-a316-b4aa18233093 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:59.630894 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:59.631875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:59.632263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:59.632560 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:59.646015 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:26:59.647553 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:26:59.666456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:26:59.667635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:26:59.668720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:26:59.668720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:26:59.668720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:26:59.668720 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:26:59.670192 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 614/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:26:59.676010 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:59.786986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:26:59.787264 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7d541-3349-4466-bd5f-b467a41444f1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:59.828125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:26:59.828896 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:26:59.829183 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:26:59.829461 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:26:59.830314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:26:59.830634 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:26:59.832169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:26:59.852412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 597/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:26:59.853760 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:26:59.988635 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d05ee-c3ff-4e2b-b6f3-cafb3192f600 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:26:59.990434 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:00.030509 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:00.031826 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:00.032115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:00.032393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:00.040958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:00.043345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:27:00.060459 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:00.061576 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:00.062472 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 615/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:26:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:00.068170 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:00.186971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96182fa-4306-4ac8-8002-36c79e0e8947 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:00.225607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:00.226338 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:00.226717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:00.227012 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:00.227852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:00.228162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:00.230153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:00.249832 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 598/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:27:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:00.255282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:00.402091 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2e4c-37e6-48ab-bcb7-ef807d08f2eb None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:00.439002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:00.439688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:00.439973 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:00.440247 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:00.472883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:00.520197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:00.521686 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:00.642922 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 616/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:27:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:27:00.648726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:00.673566 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:00.766233 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7efab-1e4b-4b43-b54c-c7d85d65c290 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:00.808721 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:00.809536 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:00.809825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:00.810109 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:00.822372 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:00.824647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:00.844767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:00.845670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:00.853120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:00.853120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:00.853120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:00.853120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:00.853120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 599/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:00.853962 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:00.939670 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:00.984130 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adc833-bef4-4527-9d7d-f048201ce65d None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:01.024782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:01.025442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:01.025715 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:01.026057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:01.027465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:01.027828 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:01.029430 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:01.043957 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 617/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:01.050102 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:01.138169 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:01.174093 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7244dc-a1c0-470b-b36d-404cf6f96e4f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:01.212386 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:01.213179 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:01.213525 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:01.214345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:01.222837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:01.223585 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:27:01.240772 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:01.241822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:01.244006 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 600/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:01.249366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:01.373132 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37101909-cabd-4ae2-b4aa-f8d7a4dca12b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:01.403591 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:01.419309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:01.420049 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:01.420423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:01.420790 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:01.421705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:01.422081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:01.423829 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb90ab0-a295-4cf3-9777-7a77f0e06498 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:01.444972 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 618/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:01.446250 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:01.575749 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200f2b6-fbb9-44f6-a696-ebe99a2376be None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:01.610104 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:01.620055 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:01.621292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:01.621584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:01.621898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:01.622742 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=f301dd333e384eabab63577777fa8616) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:01.623235 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:01.624668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151c93-5c4f-4878-8956-12c588865241 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:01.630756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 601/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:27:01 2022] GET /identity/v3/role_assignments?user.id=f301dd333e384eabab63577777fa8616&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:03.886730 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb7ad-4dc5-42b9-8f06-c10514cfe0e2 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:03.887493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb7ad-4dc5-42b9-8f06-c10514cfe0e2 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:03.887493 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb7ad-4dc5-42b9-8f06-c10514cfe0e2 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:03.888709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 619/1220] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:03.894524 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:03.895101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:03.895200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:03.912779 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:03.913997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:03.998517 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 602/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:04.025663 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cb7ad-4dc5-42b9-8f06-c10514cfe0e2 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:04.157083 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cb7ad-4dc5-42b9-8f06-c10514cfe0e2 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:04.193625 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:04.194543 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:04.194882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:04.195168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:04.207086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:27:04.215549 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:04.216733 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:04.223483 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 620/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:04.224137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:04.336785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3a53-c8b7-4901-a8da-f827b2761b78 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:04.362843 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:04.375751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:04.376485 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:04.376855 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:04.377154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:04.378499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:04.378849 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:04.380460 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:04.390175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 603/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:04.396075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:04.445882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:04.507919 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa32f93-1d49-4ff5-9001-996175f53e89 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:04.546401 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:04.547302 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:04.547618 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:04.547951 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:04.559766 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:04.561276 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:04.579418 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:04.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:04.581485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:04.581485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:04.581485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:04.581485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:04.581485 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 621/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:04.587479 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:04.719425 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba32e-273a-4724-8440-a6a4a3bb6bf7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:04.757147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:04.757980 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:04.758369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:04.758751 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:04.759617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:04.760015 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:04.762133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:04.774678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 604/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:27:04.780920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:04.894591 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:04.904393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd947b8-90f5-46a7-b35b-c222a9efd75f None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:04.947657 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:04.949089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:04.949374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:04.949648 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:04.958014 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:04.959517 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:27:04.974382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:04.975672 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:04.976964 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 622/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:04.981406 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:05.032092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:05.090024 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0411-66fb-4950-9a4c-2e42c6ee30d8 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:05.129710 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:05.130390 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:05.130681 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:05.130993 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:05.131876 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:05.132196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:05.133626 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:05.150800 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 605/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:27:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:05.157379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:05.267604 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd385a-61eb-4425-914d-d54b4001dd97 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:05.309975 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:05.310920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:05.311203 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:05.311487 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:05.322759 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:05.324303 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:05.341885 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:05.342946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:05.344045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:05.344045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:05.344045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:05.344045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:05.344045 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 623/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:05.348803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:05.454500 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426b77-6f7b-4973-8cde-1f4572d307fe None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:05.457409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:05.491576 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:05.492247 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:05.492528 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:05.492801 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:05.493534 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:05.493845 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:05.495836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:05.508214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 606/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:05.514204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:05.525410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:05.628187 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f0947-a87c-476b-ab35-f0424626329b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:05.662440 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:05.663237 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:05.663520 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:05.663793 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:05.671251 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:05.672705 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:27:05.686931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:05.687969 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:05.688872 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 624/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:05.694153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:05.798281 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79066b-86b4-4ef1-a6d3-f6322393f6f1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:05.833747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:05.834419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:05.834704 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:05.835014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:05.835807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:05.836121 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:05.837565 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55bfb-7293-478b-8a67-8f6a715b5a5e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:05.851336 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 607/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:05.858280 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:05.933946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:05.971616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d141f-fa14-44c2-bb46-f15fa81ef2cf None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:06.008754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea3e2c-cee2-4006-829c-5f889563007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:06.009636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3e2c-cee2-4006-829c-5f889563007c None admin] REQUEST_METHOD: `PUT` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:06.009902 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3e2c-cee2-4006-829c-5f889563007c None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:06.010191 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3e2c-cee2-4006-829c-5f889563007c None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/f301dd333e384eabab63577777fa8616/roles/be9903ad65dd4ce4a897deaf6924ff1f` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:06.025291 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3e2c-cee2-4006-829c-5f889563007c None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=f301dd333e384eabab63577777fa8616, role_id=be9903ad65dd4ce4a897deaf6924ff1f)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:06.026849 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3e2c-cee2-4006-829c-5f889563007c None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:06.038993 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 625/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:27:05 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/f301dd333e384eabab63577777fa8616/roles/be9903ad65dd4ce4a897deaf6924ff1f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:27:08.309835 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a522-7410-4b9f-be33-2b6e8cbc6611 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:08.310412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a522-7410-4b9f-be33-2b6e8cbc6611 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:08.310412 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a522-7410-4b9f-be33-2b6e8cbc6611 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:08.311821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 608/1233] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:08.317406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:08.317883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:08.317981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:08.343368 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:08.344608 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:08.439205 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 626/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:08.465767 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a522-7410-4b9f-be33-2b6e8cbc6611 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:08.497659 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:08.587010 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a522-7410-4b9f-be33-2b6e8cbc6611 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:08.626220 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:08.627147 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:08.627382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:08.627718 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:08.644694 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:27:08.652617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:08.653756 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:08.654764 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 609/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:08.660151 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:08.712544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:08.773622 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805f30-2fc7-436e-babc-10e7d98f5326 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:08.811615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:08.812363 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:08.812654 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:08.812948 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:08.813822 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] RBAC: Adding query filter params (name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:08.814214 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:08.815682 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:08.824886 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 627/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:08.830743 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:08.920954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:08.937592 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796fbb3-e7f8-4520-abe3-a0c5ddb68d17 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:08.972859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:08.973654 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:08.973941 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:08.974216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:08.986131 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:08.987617 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:09.005625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:09.006703 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:09.007805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:09.007805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:09.007805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:09.007805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:09.012052 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 610/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:09.012769 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:09.129436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5d10-4e91-453d-968f-2a5c7bddca12 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:09.138706 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:09.164350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:09.165025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:09.165317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:09.165594 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:09.166330 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:09.166643 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:09.168079 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:09.181273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 628/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:27:09.187546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:09.299450 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8128cb-51f0-421a-a3ba-4d55b07910cb None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:09.336313 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:09.337092 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:09.337427 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:09.337712 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:09.341158 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:09.347159 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:09.348825 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:27:09.363904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:09.365340 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:09.366719 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 611/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:27:09.371968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:09.492099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fd095-4364-4435-abf0-35b4aa2522d7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:09.531529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:09.532225 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:09.532506 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:09.532788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:09.533642 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:09.533958 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:09.535614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:09.556831 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 629/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:27:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:09.562882 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:09.677114 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe9ff4-8c55-4d22-96be-1100329f02ee None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:09.711925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:09.712584 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:09.712869 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:09.713146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:09.781847 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:09.788903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:09.790367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:09.898351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 612/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:27:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:27:09.904782 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:09.935811 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:10.013122 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9959954-f934-4fae-86ab-a082f7094ce5 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:10.050296 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:10.051309 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:10.051634 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:10.052059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:10.062931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:10.064523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:10.083788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:10.084845 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:10.085891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:10.085891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:10.085891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:10.085891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:10.090817 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 630/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:10.091692 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:10.192859 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:10.199988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644efa-e037-493e-8381-3da3182d864f None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:10.236419 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:10.237161 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:10.237473 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:10.237779 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:10.238612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:10.238933 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:10.240590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:10.252984 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 613/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:10.258983 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:10.348998 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:10.374350 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982a7bb-8591-4b1b-be0f-06d425bc917a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:10.412093 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:10.413504 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:10.413788 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:10.414067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:10.421640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:10.423336 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:27:10.438043 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:10.439906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:10.441579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 631/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:10.446625 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:10.555583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f3086-93c2-4f27-b47f-290734a29d19 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:10.592837 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:10.593620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:10.593958 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:10.594280 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:10.595335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:10.595658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:10.597378 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a38f-bf2a-4b07-9724-e7e86ffc2f9e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:10.613841 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 614/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:27:10.621176 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:10.734156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2eed-c348-4075-ba6e-55594d077d31 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:10.769920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:10.770588 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:10.770897 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:10.771177 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:10.772019 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] RBAC: Adding query filter params (role.id=be9903ad65dd4ce4a897deaf6924ff1f, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=f301dd333e384eabab63577777fa8616) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:10.772339 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:10.773799 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d1a2-2918-4a55-ad81-deb995c4a444 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:10.782813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 632/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:27:10 2022] GET /identity/v3/role_assignments?user.id=f301dd333e384eabab63577777fa8616&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=be9903ad65dd4ce4a897deaf6924ff1f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:27:13.145110 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93c14f-59bc-4ac0-ac88-5b53883d6200 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:13.145643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93c14f-59bc-4ac0-ac88-5b53883d6200 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:13.145643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93c14f-59bc-4ac0-ac88-5b53883d6200 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:13.147020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 615/1247] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:27:13.153194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:13.153636 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:13.153796 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:13.159111 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:13.174272 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:13.175533 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:13.255069 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 633/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:13.280139 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93c14f-59bc-4ac0-ac88-5b53883d6200 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:13.300252 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:13.400137 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93c14f-59bc-4ac0-ac88-5b53883d6200 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:13.439084 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:13.439967 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:13.440283 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:13.440706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:13.452830 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:27:13.461226 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:13.462293 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:13.463672 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 616/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:13.469349 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:13.580032 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f814b-1bcc-4f6a-8bbc-f8277e4f4e91 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:13.616059 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:13.622603 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:13.623479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:13.624115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:13.624566 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:13.625526 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:13.625912 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:13.627748 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:13.639734 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 634/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:13.645532 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:13.732947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:13.759308 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b25d4-7624-417b-9865-f770f33bb3ee None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:13.798291 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:13.799151 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:13.799418 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:13.799678 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:13.811761 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:13.813221 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:13.832691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:13.833911 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:13.839899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:13.839899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:13.839899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:13.839899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:13.839899 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 617/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:13.841366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:13.962002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217056-0e8f-4af7-b272-80fa280372af None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:13.999881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:14.000497 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:14.000787 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:14.001094 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:14.001895 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:14.002226 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:14.003797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:14.018015 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 635/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:14.024008 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:14.140667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3273d0-8083-4643-8e3d-79ff3e91cd83 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:14.171861 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:14.180881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:14.182363 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:14.182590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:14.182903 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:14.191172 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:14.192606 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:27:14.207979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:14.209198 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:14.210367 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 618/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:14.215358 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:14.277181 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:14.330637 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4fdf8-71a0-4bfe-956c-c7d17d61593a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:14.371046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:14.371815 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:14.372140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:14.372448 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:14.373357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:14.373669 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:14.375142 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:14.394559 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 636/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:27:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:14.401196 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:14.524564 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8525666-9eaa-4a8c-9377-7608a13f3ba0 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:14.564300 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:14.564885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:14.565175 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:14.565455 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:14.634222 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:14.649163 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:14.650981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:14.764355 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 619/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:27:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:27:14.770409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:14.882810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7467ea-6ef9-407e-9b8a-25a9bec96f3e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:14.897630 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:14.922803 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:14.923695 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:14.923985 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:14.924270 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:14.936158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:14.937639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:14.955999 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:14.957052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:14.958124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:14.958124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:14.958124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:14.958124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:14.958124 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 637/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:14.964361 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:15.061307 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:15.076026 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2184be-349f-44d2-807c-54fb96190457 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:15.115077 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:15.116033 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:15.116326 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:15.116626 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:15.117383 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:15.117694 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:15.119129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:15.131769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 620/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:27:15.137590 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:15.247991 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3e986-273f-47af-9ada-91813d60a58b None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:15.285508 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:15.286423 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:15.286749 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:15.287104 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:15.294443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:15.296063 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:27:15.311131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:15.312471 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:15.313774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 638/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:15.318382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:15.429314 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993218f-2bcb-4d91-af6c-5062c4746e75 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:15.465063 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:15.465730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:15.466013 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:15.466290 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] PATH_INFO: `/v3/projects` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:15.467113 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:15.467434 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:15.468944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae031-01f7-44f4-acb9-19be1ae81934 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:15.481066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 621/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:15.487436 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:15.516571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:15.640051 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558968c3-8a1f-4122-99d7-83dc5dfb5817 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:15.676041 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:15.676701 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:15.676981 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:15.677261 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:15.678091 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=f301dd333e384eabab63577777fa8616) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:15.678402 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:15.679884 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7736-3def-4751-b1ec-b0589f3f0c55 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:15.686048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 639/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:27:15 2022] GET /identity/v3/role_assignments?user.id=f301dd333e384eabab63577777fa8616&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:17.942938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e74b-5518-4a00-9071-31fc6039b2c8 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:17.943505 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e74b-5518-4a00-9071-31fc6039b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:17.943505 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e74b-5518-4a00-9071-31fc6039b2c8 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:17.944858 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 622/1261] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:17.950633 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:17.951057 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:17.951227 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:17.968467 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:17.969656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:18.034563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 640/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:18.056986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8e74b-5518-4a00-9071-31fc6039b2c8 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:18.067671 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:18.156690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8e74b-5518-4a00-9071-31fc6039b2c8 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:18.190246 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:18.191067 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:18.191351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:18.191630 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:18.203335 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:27:18.210988 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:18.212083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:18.213755 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 623/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:18.218745 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:18.236830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:18.317086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1993ef-7d1d-4f00-a031-4c09953420f0 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:18.350881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:18.351544 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:18.351827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:18.352108 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:18.352860 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:18.353170 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:18.354573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:18.362460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 641/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:18.368513 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:18.434796 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:18.468146 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2d41-99d8-4e66-90e3-5c9bc24ddd0d None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:18.502474 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:18.503300 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:18.503591 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:18.503874 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:18.514945 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:18.516407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:18.533128 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:18.534213 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:18.535164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:18.535164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:18.535164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:18.535164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:18.535164 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 624/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:18.540064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:18.631127 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:18.655589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df017-2867-438f-ad49-e0c2741e1ec3 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:18.691881 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:18.692480 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:18.692768 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:18.693050 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:18.693774 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:18.694086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:18.695499 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:18.707589 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 642/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:18.713818 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:18.812352 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786bdec-77f4-4426-bac5-731409da29d5 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:18.831715 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:18.848545 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:18.849348 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:18.849633 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:18.849912 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:18.857561 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:18.859036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:27:18.873451 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:18.874516 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:18.875538 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 625/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:18.880386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:18.978099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef987e-b598-4935-80e9-3385231714f8 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:19.012614 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:19.013263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:19.013541 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:19.013813 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] PATH_INFO: `/v3/users` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:19.014640 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:19.014978 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:19.016452 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:19.025396 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:19.033773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 643/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:27:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:19.039316 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:19.137629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb04dd-a0e5-4534-9d11-76fd1bb62801 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:19.172185 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:19.172986 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:19.173269 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:19.173551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:19.184814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:19.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:19.203785 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:19.204808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:19.205852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:19.205852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:19.205852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:19.205852 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:19.207706 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 626/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:19.213673 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:19.314649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4bfb7-cf26-40aa-bd84-dad2b6af2a0e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:19.352756 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:19.353522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:19.354118 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:19.354399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:19.355168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:19.355479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:19.356866 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:19.373966 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 644/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:19.375138 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:19.407415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:19.475083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bddaa-9e1f-4862-b284-8b99d06ef1cf None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:19.508668 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:19.509482 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:19.509746 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:19.510027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:19.516582 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:19.518051 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:27:19.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:19.533040 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:19.533932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 627/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:19.539207 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:19.600512 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:19.644025 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac203a-d596-4194-b6b2-a74efc90870e None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:19.676915 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:19.677573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:19.677857 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:19.678136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:19.678946 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:19.679264 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:19.680710 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c9688-545b-4caf-97f8-73d3f536a3a6 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:19.692424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 645/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:19.699064 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:19.787603 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:19.796381 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8b6f9-668c-4cfd-af50-f4badc713d3a None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:19.829134 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6089be-1077-4c2a-a415-be00ab4a8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:19.830014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6089be-1077-4c2a-a415-be00ab4a8766 None admin] REQUEST_METHOD: `PUT` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:19.830297 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6089be-1077-4c2a-a415-be00ab4a8766 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:19.830571 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6089be-1077-4c2a-a415-be00ab4a8766 None admin] PATH_INFO: `/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/f301dd333e384eabab63577777fa8616/roles/f9834d99866d4cfd93bccc3ece2ec430` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:19.832546 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6089be-1077-4c2a-a415-be00ab4a8766 None admin] RBAC: Authorizing `identity:create_grant(project_id=602e0e18525c4efb9b2822fca8caa449, user_id=f301dd333e384eabab63577777fa8616, role_id=f9834d99866d4cfd93bccc3ece2ec430)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:19.833978 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6089be-1077-4c2a-a415-be00ab4a8766 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:19.850044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 628/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:27:19 2022] PUT /identity/v3/projects/602e0e18525c4efb9b2822fca8caa449/users/f301dd333e384eabab63577777fa8616/roles/f9834d99866d4cfd93bccc3ece2ec430 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:27:22.039649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8befbc-7895-4c78-82da-d9a4d0593f8c None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.040194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8befbc-7895-4c78-82da-d9a4d0593f8c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.040194 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8befbc-7895-4c78-82da-d9a4d0593f8c None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.042092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 646/1274] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:22.047403 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.047834 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.047965 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.065027 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:22.066197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:22.131955 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 629/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:22.155911 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8befbc-7895-4c78-82da-d9a4d0593f8c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:22.268008 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8befbc-7895-4c78-82da-d9a4d0593f8c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:22.285197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:22.301868 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:22.302660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.302982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.303263 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.313783 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:27:22.321435 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:22.322496 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:22.323609 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 647/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:22.329178 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:22.407483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:22.425483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4984cc5-99b0-4091-82a0-f119e6764769 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:22.459292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:22.459960 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.460245 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.460524 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] PATH_INFO: `/v3/roles` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.461276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] RBAC: Adding query filter params (name=admin) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:22.461589 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:22.463108 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:22.471211 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 630/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:22.476840 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:22.577394 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e81a0-627e-4db5-bbb0-4a222b5c0256 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:22.610003 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:22.610816 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.611105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.611382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.622748 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:22.624250 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:22.641090 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:22.642105 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:22.643017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:22.643017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:22.643017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:22.643017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:22.643017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 648/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:22.648153 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:22.748936 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3748-5d7f-4b15-a004-590b68c9f7af None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:22.781157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:22.781814 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.782101 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.782390 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] PATH_INFO: `/v3/domains` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.783150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:22.783462 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:22.784826 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:22.796880 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 631/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:22.802390 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:22.834184 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:22.905679 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536657b-3da7-42bb-97e6-b6d137ab9479 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:22.939021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:22.939810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:22.940096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:22.940374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:22.948367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:22.949830 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:27:22.964092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:22.965193 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:22.966344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 649/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:22.970992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:22.974741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:23.070032 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f0dab-773a-4281-b59e-c33967392996 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:23.103663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:23.104321 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:23.104607 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:23.104888 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] PATH_INFO: `/v3/users` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:23.105735 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:23.106048 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:23.107499 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:23.124375 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 632/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:27:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:23.130067 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:23.219456 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:23.229460 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e2564-fbbb-423d-b70c-9d48ecdbc862 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:23.262429 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:23.263096 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:23.263385 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:23.263667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:23.329518 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:23.330927 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:23.418092 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:23.429021 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 650/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:27:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:27:23.435437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:23.495162 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:23.533261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc570-75f3-4b79-9766-5a7c0388a0ba None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:23.575515 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:23.576342 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:23.576629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:23.576907 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:23.587047 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:23.589066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:27:23.606181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:23.607239 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:23.608231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:27:23.608231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:27:23.608231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:27:23.608231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:23.608231 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 633/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:23.613081 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:23.710890 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe680f6-fb58-4939-8005-16bd25f4552a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:23.744507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:23.745158 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:23.745442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:23.745721 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] PATH_INFO: `/v3/domains` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:23.746442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:23.746752 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:23.748157 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:23.759159 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 651/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:23.765203 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:23.863670 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66854186-62f5-4cf6-976b-b7fc471e00a1 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:23.877885 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:23.898553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:23.899382 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:23.899669 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:23.900476 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:23.907133 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:23.908812 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:27:23.927662 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application with Lock( May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:23.928747 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: ERROR keystone.server.flask.application May 19 14:27:23.929711 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 634/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:23.937656 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:23.990274 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:24.039537 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f22b-05ac-4499-8803-d3072b212cff None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:24.071374 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:24.072529 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:24.072807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:24.073075 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] PATH_INFO: `/v3/projects` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:24.073850 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:24.074156 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:24.075616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a9515-cc31-4899-a045-cdd0b4580ba5 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:24.088688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 652/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:24.094765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:24.193394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013f55-6e97-4d67-9633-1515f048bca7 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:24.225610 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:24.226261 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:24.226548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:24.226850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:24.227683 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] RBAC: Adding query filter params (role.id=f9834d99866d4cfd93bccc3ece2ec430, scope.project.id=602e0e18525c4efb9b2822fca8caa449, user.id=f301dd333e384eabab63577777fa8616) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:24.228541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:24.229925 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f45ed-cf32-4fd9-b3b6-d8377755f966 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:24.235691 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 635/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:27:24 2022] GET /identity/v3/role_assignments?user.id=f301dd333e384eabab63577777fa8616&scope.project.id=602e0e18525c4efb9b2822fca8caa449&role.id=f9834d99866d4cfd93bccc3ece2ec430 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:26.523017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa6f0-f6a0-4bc5-b96f-c79bbfff213a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:26.523571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa6f0-f6a0-4bc5-b96f-c79bbfff213a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:26.523571 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa6f0-f6a0-4bc5-b96f-c79bbfff213a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:26.524980 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 653/1288] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:26.530346 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:26.530769 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:26.530938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:26.548044 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:26.549238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:26.578540 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:26.621483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 636/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:26.646197 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa6f0-f6a0-4bc5-b96f-c79bbfff213a None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:26.750751 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa6f0-f6a0-4bc5-b96f-c79bbfff213a None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:26.761300 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:26.785115 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:26.785847 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:26.786131 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:26.786406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] PATH_INFO: `/v3/services/placement` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:26.787102 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:26.788479 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:26.800696 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:26.801904 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:26.803136 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 654/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:27:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:26.808005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:26.909629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ff67-1ba2-4dcf-8c97-f27e12a7bc9b None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:26.942642 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:26.943339 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:26.943629 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:26.943910 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:26.944621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:26.944942 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:26.946315 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224b2b-aeb7-4a99-8cd5-54b6201eae3e None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:26.951682 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 637/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:27:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:26.957573 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:27.055073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cffac-71f2-4fc4-a11a-5409ece7398a None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:27.088371 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:27.089027 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:27.089317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:27.089599 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] PATH_INFO: `/v3/services` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:27.090308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] RBAC: Adding query filter params (type=placement) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:27.090621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:27.092040 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954942b5-cd6b-4ceb-b409-e756575daa16 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:27.096407 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 655/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:27:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:29.306593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8513-ecaf-441e-bed1-403665d5d460 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:29.307160 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8513-ecaf-441e-bed1-403665d5d460 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:29.307267 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8513-ecaf-441e-bed1-403665d5d460 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:29.308566 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 638/1293] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:29.313741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6516e-1b3c-4027-9064-fcfcb67db2ef None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:29.314163 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6516e-1b3c-4027-9064-fcfcb67db2ef None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:29.314306 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6516e-1b3c-4027-9064-fcfcb67db2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:29.330957 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-6ad6516e-1b3c-4027-9064-fcfcb67db2ef None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:29.332138 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-6ad6516e-1b3c-4027-9064-fcfcb67db2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:29.361089 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:29.398505 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 656/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:29.421376 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd8513-ecaf-441e-bed1-403665d5d460 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:29.452148 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:29.524631 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd8513-ecaf-441e-bed1-403665d5d460 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:29.558107 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608a1a-2dda-43dd-8d35-def5d6c4e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:29.558705 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608a1a-2dda-43dd-8d35-def5d6c4e62d None admin] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:29.559020 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608a1a-2dda-43dd-8d35-def5d6c4e62d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:29.559303 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608a1a-2dda-43dd-8d35-def5d6c4e62d None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:29.560036 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2608a1a-2dda-43dd-8d35-def5d6c4e62d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:29.561399 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2608a1a-2dda-43dd-8d35-def5d6c4e62d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:29.574105 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 639/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:27:29 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:27:31.841596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0215-3b9a-46cf-a3f3-0475eb9ba252 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:31.842159 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0215-3b9a-46cf-a3f3-0475eb9ba252 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:31.842159 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0215-3b9a-46cf-a3f3-0475eb9ba252 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:31.843818 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 657/1296] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:31.849125 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:31.849570 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:31.849696 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:31.866512 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:31.867731 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:31.938435 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 640/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:27:31.961319 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c0215-3b9a-46cf-a3f3-0475eb9ba252 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:32.061085 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c0215-3b9a-46cf-a3f3-0475eb9ba252 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:32.094639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:32.095411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:32.095697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:32.095971 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:32.096621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:32.098002 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:32.110145 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:32.111308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:32.112365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 658/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:27:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:32.117833 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:32.136857 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:32.215944 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d2c46-eea7-469a-b7f1-80ee737e4039 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:32.249555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:32.250219 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:32.250504 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:32.250782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:32.253259 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] RBAC: Adding query filter params (name=placement) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:32.253590 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:32.254964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:32.260073 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 641/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:27:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:32.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:32.297729 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:32.367596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3ffc-18f0-44d9-8b72-ba8a13e54fe7 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:32.401528 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:32.402178 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:32.402464 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:32.402745 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:32.403563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] RBAC: Adding query filter params (interface=public, service_id=c3c47eb348ef4a8d8f0248d6979541a5, region_id=RegionOne) {{(pid=143652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:32.403879 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:32.405273 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686bbb9-a5c3-4ef2-94b5-425d179901e8 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:32.410232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 659/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:27:32 2022] GET /identity/v3/endpoints?service_id=c3c47eb348ef4a8d8f0248d6979541a5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:32.415779 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:32.495815 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:32.514406 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffbc5f-3fe1-4903-95ff-671262239765 None admin] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:32.547690 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6bd8c-57c0-4759-9067-cee96fb3d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:32.548341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6bd8c-57c0-4759-9067-cee96fb3d297 None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:32.548622 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6bd8c-57c0-4759-9067-cee96fb3d297 None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:32.548898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6bd8c-57c0-4759-9067-cee96fb3d297 None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:32.549578 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6bd8c-57c0-4759-9067-cee96fb3d297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:32.550952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6bd8c-57c0-4759-9067-cee96fb3d297 None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:32.558206 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 642/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:27:32 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:27:34.793410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359931-f1a9-4b50-91db-d297eba3df1c None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:34.794244 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359931-f1a9-4b50-91db-d297eba3df1c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:34.794244 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359931-f1a9-4b50-91db-d297eba3df1c None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:34.795556 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 660/1302] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:27:34.802904 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:34.803458 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:34.804007 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:34.823234 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:27:34.824437 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:27:34.890237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 643/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:27:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:27:34.913140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359931-f1a9-4b50-91db-d297eba3df1c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:35.011073 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:35.022514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359931-f1a9-4b50-91db-d297eba3df1c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:35.058878 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:35.059615 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:35.059896 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:35.060168 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] PATH_INFO: `/v3/services/placement` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:35.060815 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:35.062204 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:27:35.074367 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:27:35.075511 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application with Lock( May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self._enter() May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application return self.creator() May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application created_value = creator( May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: ERROR keystone.server.flask.application May 19 14:27:35.076338 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 661/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:27:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:27:35.081971 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:35.156798 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:35.178892 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e3be6-bc0e-4813-b12e-4e12ddf9db18 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:35.212150 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:35.212807 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:35.213088 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:35.213368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] PATH_INFO: `/v3/services` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:35.214071 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] RBAC: Adding query filter params (name=placement) {{(pid=143653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:27:35.214379 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:35.215774 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b0575-eb63-41c9-a63c-0fcf1ae4cf5d None admin] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:35.220791 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 644/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:27:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:27:35.226443 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:27:35.324160 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42967-c0e6-4527-aede-ff1fb2f72f51 None admin] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:27:35.365400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a810b1-f57a-404f-880c-f5adf9308e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e00ecbc961470b94e1ba0cf14cceba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:27:35.366510 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a810b1-f57a-404f-880c-f5adf9308e2f None admin] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:27:35.367038 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a810b1-f57a-404f-880c-f5adf9308e2f None admin] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:27:35.367520 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a810b1-f57a-404f-880c-f5adf9308e2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:27:35.369563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a810b1-f57a-404f-880c-f5adf9308e2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:27:35.371649 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a810b1-f57a-404f-880c-f5adf9308e2f None admin] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:27:35.390441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 662/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:27:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:27:45.217808 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=30 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:27:45.386082 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:40.033062 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f0da-ee46-41f5-afbe-2c5cb028e5eb None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:40.033647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f0da-ee46-41f5-afbe-2c5cb028e5eb None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:40.033647 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f0da-ee46-41f5-afbe-2c5cb028e5eb None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:40.035188 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 645/1307] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:28:40.040820 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8bb40-0e50-43f0-a49c-7bb039ece019 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:40.041253 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8bb40-0e50-43f0-a49c-7bb039ece019 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:40.041481 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8bb40-0e50-43f0-a49c-7bb039ece019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:40.200765 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-15e8bb40-0e50-43f0-a49c-7bb039ece019 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:40.202046 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-15e8bb40-0e50-43f0-a49c-7bb039ece019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:40.423140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 663/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:28:40.489354 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900931c-6f59-4c57-b7db-a9b5e7df1342 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:40.489680 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900931c-6f59-4c57-b7db-a9b5e7df1342 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:40.489926 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900931c-6f59-4c57-b7db-a9b5e7df1342 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:40.491351 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 646/1309] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:28:40.497826 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c947-594c-44dd-8d4f-be2b63744dca None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:40.498125 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c947-594c-44dd-8d4f-be2b63744dca None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:40.498406 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c947-594c-44dd-8d4f-be2b63744dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:40.665982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-3aa7c947-594c-44dd-8d4f-be2b63744dca None None] MFA Rules not processed for user `7d83f7f26aa442d197a1d3396357a6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:40.667295 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-3aa7c947-594c-44dd-8d4f-be2b63744dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:40.717468 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:40.845419 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 664/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:28:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:28:40.856829 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900931c-6f59-4c57-b7db-a9b5e7df1342 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:28:40.858597 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-b900931c-6f59-4c57-b7db-a9b5e7df1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:41.140394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900931c-6f59-4c57-b7db-a9b5e7df1342 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:28:41.450989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:28:41.452135 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:41.452630 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:41.453126 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:41.456426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:41.568142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:41.696994 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:28:41.698860 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9cb16-6f18-41ef-b113-3639f9e5a8e6 service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:28:41.738117 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 647/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 882 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:28:44.471164 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9df22-7d1a-4830-81ea-607d36dc6941 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:44.471688 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9df22-7d1a-4830-81ea-607d36dc6941 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:44.471797 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9df22-7d1a-4830-81ea-607d36dc6941 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:44.473864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 665/1312] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:28:44.480475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd59c-2cca-4267-9151-98a903cd6b13 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:44.480932 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd59c-2cca-4267-9151-98a903cd6b13 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:44.481041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd59c-2cca-4267-9151-98a903cd6b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:44.566046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-4a5dd59c-2cca-4267-9151-98a903cd6b13 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:44.567325 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-4a5dd59c-2cca-4267-9151-98a903cd6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:44.669663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 648/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:28:44.707616 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9df22-7d1a-4830-81ea-607d36dc6941 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:28:44.709141 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-13f9df22-7d1a-4830-81ea-607d36dc6941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:44.820532 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9df22-7d1a-4830-81ea-607d36dc6941 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:28:44.898077 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:44.900754 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:28:44.901837 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:44.902122 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:44.902398 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:44.904491 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:45.021442 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:28:45.022963 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c34be-d9d5-47e8-8183-b4d55cd876e6 service neutron] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:28:45.050074 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 666/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:28:47.621981 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15dc97-37bf-4a21-99c2-7f1b8187abbc None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:47.622511 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15dc97-37bf-4a21-99c2-7f1b8187abbc None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:47.622598 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15dc97-37bf-4a21-99c2-7f1b8187abbc None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:47.623979 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 649/1315] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:28:47.629345 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889782-d330-4505-87cb-5aa03bfe9d22 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:47.629793 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889782-d330-4505-87cb-5aa03bfe9d22 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:47.629931 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889782-d330-4505-87cb-5aa03bfe9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:47.694699 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-63889782-d330-4505-87cb-5aa03bfe9d22 None None] MFA Rules not processed for user `4427c679f7c645b989ffdfcc836ce81e`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:47.695920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-63889782-d330-4505-87cb-5aa03bfe9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:47.746982 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:47.791449 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 667/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:28:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:28:47.832042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15dc97-37bf-4a21-99c2-7f1b8187abbc None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:28:47.833646 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-5d15dc97-37bf-4a21-99c2-7f1b8187abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:47.843547 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:47.936844 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15dc97-37bf-4a21-99c2-7f1b8187abbc None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:28:48.008753 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:28:48.009322 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:48.009605 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:48.009881 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:48.011551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:48.072821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:48.118643 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:28:48.120100 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5140-b42c-4d77-b1b7-294c7727c021 service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:28:48.137548 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 650/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:28:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:28:50.921458 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbe67-dacc-463a-9a50-699384671100 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:50.921976 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbe67-dacc-463a-9a50-699384671100 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:50.922062 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbe67-dacc-463a-9a50-699384671100 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:50.923437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 668/1318] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:28:50.928732 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3edc2d-2d10-4a63-8e37-b2e4fda6af3e None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:50.929155 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3edc2d-2d10-4a63-8e37-b2e4fda6af3e None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:50.929294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3edc2d-2d10-4a63-8e37-b2e4fda6af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:50.993700 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-de3edc2d-2d10-4a63-8e37-b2e4fda6af3e None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:50.994919 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-de3edc2d-2d10-4a63-8e37-b2e4fda6af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:51.089620 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 651/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:28:51.127387 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdbe67-dacc-463a-9a50-699384671100 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:28:51.129474 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-26cdbe67-dacc-463a-9a50-699384671100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:51.231968 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdbe67-dacc-463a-9a50-699384671100 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:28:51.305668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:28:51.306308 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:51.306596 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:51.306907 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:51.308554 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:51.315400 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:51.417213 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:28:51.418579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e324-a27f-4f98-b5e9-6d41b766d396 service neutron] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:28:51.436810 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 669/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:28:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:28:54.368541 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49385c6-4197-4e1f-9d80-8004a636c04c None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:54.369081 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49385c6-4197-4e1f-9d80-8004a636c04c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:54.369201 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49385c6-4197-4e1f-9d80-8004a636c04c None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:54.370593 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 652/1321] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:28:54.375989 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1321b7-23a5-45ba-bedb-952c06ca002b None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:54.376382 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1321b7-23a5-45ba-bedb-952c06ca002b None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:54.376567 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1321b7-23a5-45ba-bedb-952c06ca002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:54.440379 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-db1321b7-23a5-45ba-bedb-952c06ca002b None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:54.441631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-db1321b7-23a5-45ba-bedb-952c06ca002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:54.499540 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:54.539387 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 670/1322] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:28:54.575938 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49385c6-4197-4e1f-9d80-8004a636c04c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:28:54.577553 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-d49385c6-4197-4e1f-9d80-8004a636c04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:54.597208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:54.686074 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49385c6-4197-4e1f-9d80-8004a636c04c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:28:54.760345 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:28:54.760997 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:54.761277 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:54.761551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:54.763217 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:54.833612 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:54.875947 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:28:54.877388 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20865a22-4819-4db2-b121-d92c10105a66 service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:28:54.896410 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 653/1323] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:28:57.346660 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f9e8-425d-47f5-982c-79441f15f592 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:57.347801 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f9e8-425d-47f5-982c-79441f15f592 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:57.347891 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f9e8-425d-47f5-982c-79441f15f592 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:57.349282 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 671/1324] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:28:57.355099 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea870f7-ce1e-4a89-9a99-e68f0f435175 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:57.355540 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea870f7-ce1e-4a89-9a99-e68f0f435175 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:57.355663 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea870f7-ce1e-4a89-9a99-e68f0f435175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:57.420934 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-bea870f7-ce1e-4a89-9a99-e68f0f435175 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:28:57.422204 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-bea870f7-ce1e-4a89-9a99-e68f0f435175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:57.522483 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 654/1325] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:28:57.558048 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f9e8-425d-47f5-982c-79441f15f592 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:28:57.559621 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-dee5f9e8-425d-47f5-982c-79441f15f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:57.670685 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f9e8-425d-47f5-982c-79441f15f592 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:28:57.745064 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:28:57.745724 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:28:57.746015 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:28:57.746293 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:28:57.747986 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:28:57.765195 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:28:57.862076 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:28:57.863668 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a772d-6cf3-4512-b60a-5c7c13b557e4 service neutron] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:28:57.882521 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 672/1326] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:00.165805 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951daf86-140f-4665-88af-6a99eed76954 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:00.166341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951daf86-140f-4665-88af-6a99eed76954 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:00.166341 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951daf86-140f-4665-88af-6a99eed76954 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:00.167728 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 655/1327] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:00.173342 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f3d4-1275-465e-a4c8-042005030432 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:00.173775 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f3d4-1275-465e-a4c8-042005030432 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:00.173920 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f3d4-1275-465e-a4c8-042005030432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:00.239140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-1a95f3d4-1275-465e-a4c8-042005030432 None None] MFA Rules not processed for user `4427c679f7c645b989ffdfcc836ce81e`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:00.240357 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-1a95f3d4-1275-465e-a4c8-042005030432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:00.304386 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:00.339997 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 673/1328] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:00.377237 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951daf86-140f-4665-88af-6a99eed76954 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:00.379391 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-951daf86-140f-4665-88af-6a99eed76954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:00.413877 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:00.485871 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951daf86-140f-4665-88af-6a99eed76954 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:00.558456 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:00.559154 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:00.559445 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:00.559725 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:00.561380 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:00.639402 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:00.670748 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:00.672212 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76a536-1294-47b3-b5e9-9128f309b31d service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:00.691443 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 656/1329] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:03.109617 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92917bd-bd3c-41e5-901c-6f4117a60c13 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:03.110147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92917bd-bd3c-41e5-901c-6f4117a60c13 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:03.110147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92917bd-bd3c-41e5-901c-6f4117a60c13 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:03.111563 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 674/1330] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:03.116964 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea953-3bba-46a2-8b1a-1fbf8587ec27 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:03.117384 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea953-3bba-46a2-8b1a-1fbf8587ec27 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:03.117519 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea953-3bba-46a2-8b1a-1fbf8587ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:03.182167 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-759ea953-3bba-46a2-8b1a-1fbf8587ec27 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:03.183390 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-759ea953-3bba-46a2-8b1a-1fbf8587ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:03.277646 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 657/1331] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:03.328842 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea874fe-101a-453c-9da6-0db30c09fde1 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:03.329134 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea874fe-101a-453c-9da6-0db30c09fde1 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:03.329424 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea874fe-101a-453c-9da6-0db30c09fde1 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:03.331557 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 675/1332] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:03.337389 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a1fa-8aa9-44ed-982d-358624bf1a1a None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:03.337676 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a1fa-8aa9-44ed-982d-358624bf1a1a None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:03.337953 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a1fa-8aa9-44ed-982d-358624bf1a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:03.382855 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:03.413278 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-3807a1fa-8aa9-44ed-982d-358624bf1a1a None None] MFA Rules not processed for user `7d83f7f26aa442d197a1d3396357a6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:03.414487 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-3807a1fa-8aa9-44ed-982d-358624bf1a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:03.490409 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 658/1333] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:03.499277 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea874fe-101a-453c-9da6-0db30c09fde1 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:03.500803 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-4ea874fe-101a-453c-9da6-0db30c09fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:03.602835 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea874fe-101a-453c-9da6-0db30c09fde1 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:03.678140 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:03.678714 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:03.679029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:03.679311 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:03.680988 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:03.707857 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:03.790384 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:03.791882 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903d50e-259c-4ad8-b4b6-ff1cdab50e3f service neutron] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:03.811791 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 676/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:06.299989 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf1c29-c6cf-4012-a9eb-28c897590cd0 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:06.300529 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf1c29-c6cf-4012-a9eb-28c897590cd0 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:06.300623 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf1c29-c6cf-4012-a9eb-28c897590cd0 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:06.301948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 659/1335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:06.307241 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327eb9-57cd-42b9-87a3-cbb47327a271 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:06.307669 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327eb9-57cd-42b9-87a3-cbb47327a271 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:06.307806 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327eb9-57cd-42b9-87a3-cbb47327a271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:06.372741 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-6d327eb9-57cd-42b9-87a3-cbb47327a271 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:06.373965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-6d327eb9-57cd-42b9-87a3-cbb47327a271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:06.449759 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:06.473086 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 677/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:06.512390 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf1c29-c6cf-4012-a9eb-28c897590cd0 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:06.513918 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-8aaf1c29-c6cf-4012-a9eb-28c897590cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:06.615948 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf1c29-c6cf-4012-a9eb-28c897590cd0 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:06.642992 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:06.687820 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:06.688461 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:06.688741 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:06.689014 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:06.691214 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:06.797362 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:06.798782 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bd0d-08e7-43be-b713-4e3d39ce33c1 service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:06.816783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 660/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:09.706232 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c26f-1ad8-4d6b-90ce-c94d0a9a965c None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:09.706827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c26f-1ad8-4d6b-90ce-c94d0a9a965c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:09.706827 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c26f-1ad8-4d6b-90ce-c94d0a9a965c None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:09.708222 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 678/1338] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:09.713358 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b71f9-4e62-4dad-a05f-93656e7598f1 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:09.713803 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b71f9-4e62-4dad-a05f-93656e7598f1 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:09.713898 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b71f9-4e62-4dad-a05f-93656e7598f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:09.778042 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-f90b71f9-4e62-4dad-a05f-93656e7598f1 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:09.779274 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-f90b71f9-4e62-4dad-a05f-93656e7598f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:09.787475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:09.874922 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 661/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:09.910974 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c26f-1ad8-4d6b-90ce-c94d0a9a965c None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:09.912514 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-2563c26f-1ad8-4d6b-90ce-c94d0a9a965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:10.015825 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c26f-1ad8-4d6b-90ce-c94d0a9a965c None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:10.092080 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:10.092735 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:10.093024 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:10.093307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:10.095415 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:10.133542 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:10.208523 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:10.210039 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38165f-b0ce-4e21-ab97-8d60ef8b0e8a service neutron] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:10.230147 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 679/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:14.614369 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae7e3-b30a-46fa-b35e-7dc4b5dfce76 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:14.614952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae7e3-b30a-46fa-b35e-7dc4b5dfce76 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:14.614952 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae7e3-b30a-46fa-b35e-7dc4b5dfce76 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:14.616292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 662/1341] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:14.621773 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5df06c-236d-4860-b3b1-dba23f4f9c0c None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:14.622215 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5df06c-236d-4860-b3b1-dba23f4f9c0c None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:14.622465 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5df06c-236d-4860-b3b1-dba23f4f9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:14.692285 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-dc5df06c-236d-4860-b3b1-dba23f4f9c0c None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:14.693492 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-dc5df06c-236d-4860-b3b1-dba23f4f9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:14.785161 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=100 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:14.799372 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 680/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:14.837441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ae7e3-b30a-46fa-b35e-7dc4b5dfce76 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:14.839628 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-199ae7e3-b30a-46fa-b35e-7dc4b5dfce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:14.936555 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ae7e3-b30a-46fa-b35e-7dc4b5dfce76 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:14.940783 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139170f1-d17a-4e07-a095-359075623acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:14.941439 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139170f1-d17a-4e07-a095-359075623acc service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:14.941724 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139170f1-d17a-4e07-a095-359075623acc service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:14.942005 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139170f1-d17a-4e07-a095-359075623acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:14.951218 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139170f1-d17a-4e07-a095-359075623acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:14.952650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139170f1-d17a-4e07-a095-359075623acc service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:14.962142 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 663/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:17.785111 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf26c-41c4-4b57-9b1f-691f888ec2cd None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:17.785631 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf26c-41c4-4b57-9b1f-691f888ec2cd None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:17.785727 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf26c-41c4-4b57-9b1f-691f888ec2cd None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:17.787269 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 681/1344] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:17.792667 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a3aa-34f9-4850-b4e9-d861e6a8a1ae None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:17.793066 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a3aa-34f9-4850-b4e9-d861e6a8a1ae None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:17.793232 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a3aa-34f9-4850-b4e9-d861e6a8a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:17.821446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-4e01a3aa-34f9-4850-b4e9-d861e6a8a1ae None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:17.822551 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-4e01a3aa-34f9-4850-b4e9-d861e6a8a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:17.853318 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:17.903954 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 664/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:17.940709 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf26c-41c4-4b57-9b1f-691f888ec2cd None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:17.951284 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf26c-41c4-4b57-9b1f-691f888ec2cd None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:17.954883 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7333-94d5-4c1e-b902-c875ee5b0fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:17.955557 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7333-94d5-4c1e-b902-c875ee5b0fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:17.955844 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7333-94d5-4c1e-b902-c875ee5b0fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:17.956123 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7333-94d5-4c1e-b902-c875ee5b0fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:17.964950 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7333-94d5-4c1e-b902-c875ee5b0fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:17.966502 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7333-94d5-4c1e-b902-c875ee5b0fc2 service neutron] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:17.976393 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 682/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:22.422836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed894-c5fc-406d-89bc-aa0c85eb2d7c None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:22.423446 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed894-c5fc-406d-89bc-aa0c85eb2d7c None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:22.423621 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed894-c5fc-406d-89bc-aa0c85eb2d7c None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:22.425717 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 665/1347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:22.431120 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdefe7-4672-400c-992f-955d102a4e0a None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:22.431516 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdefe7-4672-400c-992f-955d102a4e0a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:22.431680 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdefe7-4672-400c-992f-955d102a4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:22.453863 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-74cdefe7-4672-400c-992f-955d102a4e0a None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:22.455697 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-74cdefe7-4672-400c-992f-955d102a4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:22.463665 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 683/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:22.501202 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ed894-c5fc-406d-89bc-aa0c85eb2d7c None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:22.503432 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e78ed894-c5fc-406d-89bc-aa0c85eb2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:22.516120 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ed894-c5fc-406d-89bc-aa0c85eb2d7c None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:22.520276 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cc7ef-902d-48b7-b940-5dd1205f98f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d83f7f26aa442d197a1d3396357a6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:22.520910 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cc7ef-902d-48b7-b940-5dd1205f98f7 service neutron] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:22.521199 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cc7ef-902d-48b7-b940-5dd1205f98f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:22.521475 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cc7ef-902d-48b7-b940-5dd1205f98f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:22.530216 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cc7ef-902d-48b7-b940-5dd1205f98f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:22.531661 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cc7ef-902d-48b7-b940-5dd1205f98f7 service neutron] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:22.541018 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 666/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:28.084807 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519902d-b020-4fd1-8524-3def0696272f None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:28.085347 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519902d-b020-4fd1-8524-3def0696272f None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:28.085347 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519902d-b020-4fd1-8524-3def0696272f None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:28.087029 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 684/1350] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:28.091998 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e38d-758f-4515-83db-885f4c4dcede None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:28.092407 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e38d-758f-4515-83db-885f4c4dcede None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:28.092554 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e38d-758f-4515-83db-885f4c4dcede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:28.178215 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-52a9e38d-758f-4515-83db-885f4c4dcede None None] MFA Rules not processed for user `f301dd333e384eabab63577777fa8616`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:28.179614 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-52a9e38d-758f-4515-83db-885f4c4dcede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:28.309181 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 667/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:32.446548 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=13 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:32.593052 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5726-8ee2-4381-be90-3159c433b0c3 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:32.593344 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5726-8ee2-4381-be90-3159c433b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:32.593822 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5726-8ee2-4381-be90-3159c433b0c3 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:32.595410 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 685/1352] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:32.600836 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37990d1d-734f-416c-bbf1-d35b18b432a9 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:32.601310 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37990d1d-734f-416c-bbf1-d35b18b432a9 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:32.601697 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37990d1d-734f-416c-bbf1-d35b18b432a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:32.630275 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-37990d1d-734f-416c-bbf1-d35b18b432a9 None None] MFA Rules not processed for user `f301dd333e384eabab63577777fa8616`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:32.632416 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-37990d1d-734f-416c-bbf1-d35b18b432a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:32.645200 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 668/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:34.207397 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77268-5aca-44d4-b5ab-f3f6623279d4 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:34.207940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77268-5aca-44d4-b5ab-f3f6623279d4 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:34.207940 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77268-5aca-44d4-b5ab-f3f6623279d4 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:34.209333 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 686/1354] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:34.214152 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab929c-47c3-4def-bdec-ebecfc607ba0 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:34.214573 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab929c-47c3-4def-bdec-ebecfc607ba0 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:34.214736 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab929c-47c3-4def-bdec-ebecfc607ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:34.233760 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-b3ab929c-47c3-4def-bdec-ebecfc607ba0 None None] MFA Rules not processed for user `f301dd333e384eabab63577777fa8616`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:34.235658 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-b3ab929c-47c3-4def-bdec-ebecfc607ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:34.244415 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 669/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:29:38.090965 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6c05c-18d3-4799-b0ab-1ecb4ea3e641 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:38.091495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6c05c-18d3-4799-b0ab-1ecb4ea3e641 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:38.091495 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6c05c-18d3-4799-b0ab-1ecb4ea3e641 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:38.092786 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 687/1356] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:38.098745 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa6a6-5319-4638-b2c1-b7d3c37dcfe4 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:38.099157 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa6a6-5319-4638-b2c1-b7d3c37dcfe4 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:38.099344 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa6a6-5319-4638-b2c1-b7d3c37dcfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:38.117821 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-0cdfa6a6-5319-4638-b2c1-b7d3c37dcfe4 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:38.119046 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-0cdfa6a6-5319-4638-b2c1-b7d3c37dcfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:38.127083 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 670/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:29:38.183324 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f974fc-c9f5-4cca-9cc2-17075868b978 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:38.183915 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f974fc-c9f5-4cca-9cc2-17075868b978 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:38.184399 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f974fc-c9f5-4cca-9cc2-17075868b978 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:38.186307 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 688/1358] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:29:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:38.195916 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb870-c21f-4f20-b249-f225a212becc None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:38.196507 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb870-c21f-4f20-b249-f225a212becc None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:38.197122 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb870-c21f-4f20-b249-f225a212becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:38.253726 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=100 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:38.263608 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-e9ffb870-c21f-4f20-b249-f225a212becc None None] MFA Rules not processed for user `dc16b79859ae48a2a54a68666fc9dc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:38.265071 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-e9ffb870-c21f-4f20-b249-f225a212becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:38.351238 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 671/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:29:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:38.359016 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f974fc-c9f5-4cca-9cc2-17075868b978 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:38.373898 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f974fc-c9f5-4cca-9cc2-17075868b978 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:38.379317 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab51d65-157b-42c8-9052-8475afc81822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc16b79859ae48a2a54a68666fc9dc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:38.379953 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab51d65-157b-42c8-9052-8475afc81822 service nova] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:38.380411 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab51d65-157b-42c8-9052-8475afc81822 service nova] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:38.380708 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab51d65-157b-42c8-9052-8475afc81822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:38.390365 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab51d65-157b-42c8-9052-8475afc81822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:38.392167 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab51d65-157b-42c8-9052-8475afc81822 service nova] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:38.404829 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 689/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:40.855550 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2456-476f-43e7-b4c5-ef67a015bf47 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:40.856023 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2456-476f-43e7-b4c5-ef67a015bf47 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:40.856368 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2456-476f-43e7-b4c5-ef67a015bf47 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:40.857765 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 672/1361] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:40.863875 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996715e-c3c3-4486-aa1b-15e3ce32600d None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:40.864341 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996715e-c3c3-4486-aa1b-15e3ce32600d None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:40.864437 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996715e-c3c3-4486-aa1b-15e3ce32600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:40.883359 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-b996715e-c3c3-4486-aa1b-15e3ce32600d None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:40.884579 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-b996715e-c3c3-4486-aa1b-15e3ce32600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:40.893228 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 690/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:40.937174 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2456-476f-43e7-b4c5-ef67a015bf47 None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:40.952951 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2456-476f-43e7-b4c5-ef67a015bf47 None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:40.958650 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965fd86-ad76-4258-b74a-dd04ea0a351c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc16b79859ae48a2a54a68666fc9dc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:40.959337 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965fd86-ad76-4258-b74a-dd04ea0a351c service nova] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:40.959622 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965fd86-ad76-4258-b74a-dd04ea0a351c service nova] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:40.959913 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965fd86-ad76-4258-b74a-dd04ea0a351c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:40.969646 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965fd86-ad76-4258-b74a-dd04ea0a351c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:40.971296 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965fd86-ad76-4258-b74a-dd04ea0a351c service nova] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:40.981884 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 673/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:43.565522 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac081d7-49bd-44fc-968f-1d0b1b8c0a6a None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:43.566144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac081d7-49bd-44fc-968f-1d0b1b8c0a6a None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:43.566144 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac081d7-49bd-44fc-968f-1d0b1b8c0a6a None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:43.567507 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 691/1364] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:43.573003 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421170-d31e-42b0-a773-f218f6306601 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:43.573441 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421170-d31e-42b0-a773-f218f6306601 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:43.573656 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421170-d31e-42b0-a773-f218f6306601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:43.592230 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-cb421170-d31e-42b0-a773-f218f6306601 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:43.593426 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-cb421170-d31e-42b0-a773-f218f6306601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:43.602208 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 674/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:43.648859 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb53cc-b11f-4204-9ac5-db155a0d65f7 None None] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:43.649486 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb53cc-b11f-4204-9ac5-db155a0d65f7 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:43.649841 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb53cc-b11f-4204-9ac5-db155a0d65f7 None None] PATH_INFO: `/` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:43.651366 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 692/1366] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:43.657727 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dec5b-c43c-4b69-ba34-b814b47a35e2 None None] REQUEST_METHOD: `POST` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:43.658017 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dec5b-c43c-4b69-ba34-b814b47a35e2 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:43.658292 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dec5b-c43c-4b69-ba34-b814b47a35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:43.677009 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.auth.core [None req-6d1dec5b-c43c-4b69-ba34-b814b47a35e2 None None] MFA Rules not processed for user `dc16b79859ae48a2a54a68666fc9dc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=143653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:43.678197 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.fernet_utils [None req-6d1dec5b-c43c-4b69-ba34-b814b47a35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:43.687583 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 675/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:43.695290 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb53cc-b11f-4204-9ac5-db155a0d65f7 None None] Authenticating user token {{(pid=143652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:43.710239 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb53cc-b11f-4204-9ac5-db155a0d65f7 None None] Validating token access rules against request {{(pid=143652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:43.716441 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da687b45-2a21-4165-a474-8a3bca25a72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc16b79859ae48a2a54a68666fc9dc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:43.717114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da687b45-2a21-4165-a474-8a3bca25a72e service nova] REQUEST_METHOD: `GET` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:43.717409 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da687b45-2a21-4165-a474-8a3bca25a72e service nova] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:43.717667 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da687b45-2a21-4165-a474-8a3bca25a72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:43.728372 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da687b45-2a21-4165-a474-8a3bca25a72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:43.730088 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da687b45-2a21-4165-a474-8a3bca25a72e service nova] RBAC: Authorization granted {{(pid=143652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:43.741906 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 693/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:44.515923 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a0734-9593-4b81-8914-51964d84caa8 None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:44.516294 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a0734-9593-4b81-8914-51964d84caa8 None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:44.516523 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a0734-9593-4b81-8914-51964d84caa8 None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:44.518394 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 676/1369] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:44.524470 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbc72-da20-4a0f-b453-3714df5f18c0 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:44.524757 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbc72-da20-4a0f-b453-3714df5f18c0 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:44.525217 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbc72-da20-4a0f-b453-3714df5f18c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:44.546728 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-450fbc72-da20-4a0f-b453-3714df5f18c0 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:44.548639 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-450fbc72-da20-4a0f-b453-3714df5f18c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:44.562864 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 694/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:29:46.072312 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67d031-81dd-4531-a09d-548391ec7b6d None None] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:46.072874 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67d031-81dd-4531-a09d-548391ec7b6d None None] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:46.072874 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67d031-81dd-4531-a09d-548391ec7b6d None None] PATH_INFO: `/` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:46.074260 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 677/1371] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:29:46.081254 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc684c3-ad97-460f-8156-19dde2bfd5d2 None None] REQUEST_METHOD: `POST` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:46.081684 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc684c3-ad97-460f-8156-19dde2bfd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:46.081824 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc684c3-ad97-460f-8156-19dde2bfd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:46.100099 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.auth.core [None req-6dc684c3-ad97-460f-8156-19dde2bfd5d2 None None] MFA Rules not processed for user `28e00ecbc961470b94e1ba0cf14cceba`. Rule list: `[]` (Enabled: `True`). {{(pid=143652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:29:46.101340 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG keystone.common.fernet_utils [None req-6dc684c3-ad97-460f-8156-19dde2bfd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:29:46.109677 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: [pid: 143652|app: 0|req: 695/1372] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:29:46.152850 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67d031-81dd-4531-a09d-548391ec7b6d None None] Authenticating user token {{(pid=143653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:29:46.168041 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67d031-81dd-4531-a09d-548391ec7b6d None None] Validating token access rules against request {{(pid=143653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:29:46.174129 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6194d-5adc-43e6-9b41-76db2756d820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc16b79859ae48a2a54a68666fc9dc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602e0e18525c4efb9b2822fca8caa449', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:29:46.174822 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6194d-5adc-43e6-9b41-76db2756d820 service nova] REQUEST_METHOD: `GET` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:29:46.175116 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6194d-5adc-43e6-9b41-76db2756d820 service nova] SCRIPT_NAME: `/identity` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:29:46.175398 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6194d-5adc-43e6-9b41-76db2756d820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:29:46.184730 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6194d-5adc-43e6-9b41-76db2756d820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:29:46.186315 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6194d-5adc-43e6-9b41-76db2756d820 service nova] RBAC: Authorization granted {{(pid=143653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:29:46.196905 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: [pid: 143653|app: 0|req: 678/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:29:56.095114 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: DEBUG dbcounter [-] [143652] Writing DB stats keystone:SELECT=21 {{(pid=143652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:29:56.192646 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: DEBUG dbcounter [-] [143653] Writing DB stats keystone:SELECT=54 {{(pid=143653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:30:08.256951 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: Thu May 19 14:30:08 2022 - graceful shutdown triggered... May 19 14:30:08.257085 dv-cinder-788367-10-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 19 14:30:08.257637 dv-cinder-788367-10-iscsi devstack@keystone.service[143653]: Gracefully killing worker 2 (pid: 143653)... May 19 14:30:08.258017 dv-cinder-788367-10-iscsi devstack@keystone.service[143652]: Gracefully killing worker 1 (pid: 143652)... May 19 14:30:09.258708 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: worker 1 buried after 1 seconds May 19 14:30:09.258708 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: worker 2 buried after 1 seconds May 19 14:30:09.259304 dv-cinder-788367-10-iscsi devstack@keystone.service[143642]: goodbye to uWSGI. May 19 14:30:09.260261 dv-cinder-788367-10-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 19 14:30:09.260831 dv-cinder-788367-10-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 19 14:36:04.363432 dv-cinder-788367-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 14:36:04.370774 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 14:36:04 2022] *** May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: nodename: dv-cinder-788367-10-iscsi May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: machine: x86_64 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: clock source: unix May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: pcre jit disabled May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: detected number of CPU cores: 4 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: current working directory: / May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: detected binary path: /usr/bin/uwsgi-core May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: your processes number limit is 47680 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: your memory page size is 4096 bytes May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: detected max file descriptor number: 2048 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: lock engine: pthread robust mutexes May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: thunder lock: enabled May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 14:36:04.374308 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 14:36:04.419752 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: Python main interpreter initialized at 0x55766cd419c0 May 19 14:36:04.419752 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: python threads support enabled May 19 14:36:04.419752 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: your server socket listen backlog is limited to 100 connections May 19 14:36:04.419752 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: your mercy for graceful operations on workers is 90 seconds May 19 14:36:04.420203 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: mapped 403077 bytes (393 KB) for 2 cores May 19 14:36:04.420203 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: *** Operational MODE: preforking *** May 19 14:36:04.420438 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: *** uWSGI is running in multiple interpreter mode *** May 19 14:36:04.420524 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: spawned uWSGI master process (pid: 206990) May 19 14:36:04.420656 dv-cinder-788367-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 14:36:04.421889 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: spawned uWSGI worker 1 (pid: 206998, cores: 1) May 19 14:36:04.422980 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: spawned uWSGI worker 2 (pid: 206999, cores: 1) May 19 14:36:04.422980 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 14:36:10.097035 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:36:10.097035 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: from cryptography.utils import int_from_bytes May 19 14:36:10.097902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:36:10.097902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: from cryptography.utils import int_from_bytes May 19 14:36:10.146679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:36:10.146891 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:36:10.146992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:36:10.146992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: from cryptography.utils import int_from_bytes May 19 14:36:10.147490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] command line args: [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:36:10.147596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:36:10.147596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: from cryptography.utils import int_from_bytes May 19 14:36:10.147741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:36:10.147741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ================================================================================ {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:36:10.147741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] admin_token = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.147982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] config_dir = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.148138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.148317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] config_source = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.148495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] debug = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.148690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.149046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.149225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] insecure_debug = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.149480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.149729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.149962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.150140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_config_append = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.150317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.150492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_dir = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.150689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_file = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.150926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.151176 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.151446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.151671 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.151863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.152081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.152278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.152469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.152694 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.152914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.153148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.153375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.153614 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.153858 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] notification_format = cadf {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.154142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.154631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.154833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] publish_errors = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.155063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.155278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.155446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.155690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.155926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.156177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] standard_threads = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.156387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] strict_password_check = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.156630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.157421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] use_eventlog = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.157568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] use_journal = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.157701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] use_json = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.157867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] use_stderr = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.158041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] use_syslog = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.158272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] watch_log_file = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.158637 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.158908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.159172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.159411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.159662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.159902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.160153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.160390 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.160638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.160886 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.161148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.161371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.161619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.161854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.162103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.162352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.162589 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.162866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.163124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.163369 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.163606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.163860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.164125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.164379 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.164629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.164863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.165096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.165329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.165564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.165813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.166061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.166292 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.166522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.166769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.167041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.167278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.167527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.167758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.167992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.168226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.168456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.168686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.168916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.169145 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.169380 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.169627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.169859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.170096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.170326 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.170559 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.170809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.171062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.171292 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.171528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.171765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.172000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.172236 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.172497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.172730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.172979 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.173214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.173453 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.173686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.173946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.174187 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.174419 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.174656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.174915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.175184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.175419 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.175668 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.175912 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.176147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.176382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.176616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.176861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.enabled = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.177098 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.177333 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.177573 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.177810 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.178046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.178278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.178513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.178747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.179030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.179293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.179507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.179745 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.179985 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.180222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.180457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.180692 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.180922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.181151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.181381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.181613 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.181844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.182081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.182314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.182562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.182809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.183190 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.183452 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.183697 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.183932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.external = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.184169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.mapped = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.184469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.184705 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.184939 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.password = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.185171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] auth.token = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.185413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.185650 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] catalog.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.185900 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.186132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.186385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.186635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.186893 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.187131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.187381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.187631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.187880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.188146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.188392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.188628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.188892 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.189148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.189385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.189638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.189924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.190171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.190432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.190674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.190953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.191188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.191425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.191670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.191916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.192146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.192393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.192630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.192884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.193119 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.193374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.193610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.193855 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.194088 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.194341 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.194588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.194842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.195013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:36:10.195154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.195288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:36:10.195428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.195562 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] command line args: [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:36:10.195696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.195828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:36:10.195962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.196101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ================================================================================ {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:36:10.196235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.196362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] admin_token = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.196500 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.196624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] config_dir = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.196750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.196888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.197022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.197154 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] config_source = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.197154 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] debug = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.197409 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.197541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.197709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.197853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.197979 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.198104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] insecure_debug = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.198235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.198370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.198503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.198637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.198770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.198930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.198930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_config_append = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.199182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.199309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.199434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.199566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_dir = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.199701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.199832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_file = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.199971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.200098 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.200223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.200347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.200478 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.200604 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.200742 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.200875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.201011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.201136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.201136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.201387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.201534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.201698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.201837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.201965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.202097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.202240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.202373 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.202500 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.202631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.202763 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.202922 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.203063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.203216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.203350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.203483 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] notification_format = cadf {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.203610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.203610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.204371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.204505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.password = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.204505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.204764 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.204892 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.205032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] publish_errors = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.205164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.205296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.205435 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.205561 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.205561 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.205827 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.205953 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.206087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.206219 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.206345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.206476 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] standard_threads = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.206615 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.206748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] strict_password_check = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.206924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.207059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.207059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] use_eventlog = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.207297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.207435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] use_journal = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.207562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.207686 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] use_json = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.207817 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.207949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] use_stderr = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.207949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] use_syslog = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.208204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.208336 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] watch_log_file = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:36:10.208470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.208470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.208719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.208852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.208995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.209931 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210190 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210454 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210592 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.210878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211015 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211148 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211282 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211693 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.211952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212211 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212749 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.212882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213400 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.213934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214067 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214457 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.214886 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215160 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215302 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215569 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215702 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] policy.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.215973 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216756 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] receipt.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.216888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217227 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217623 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.217876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218671 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.218859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.219000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.219134 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.219268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220558 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220685 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] revoke.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.220977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221118 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221379 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221506 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] role.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221638 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] role.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.221908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] role.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222313 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] role.list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222449 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.222875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223005 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223257 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.223925 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224058 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.224878 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225286 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225419 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225685 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.225953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226738 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.226895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227559 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.227956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228219 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228491 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.228884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.enabled = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.229947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230366 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.230997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.231127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.231260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.231393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.231535 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.231669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232067 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232197 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.provider = fernet {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232336 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.232996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233388 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233787 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.233912 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] trust.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234295 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.234834 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235136 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235274 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235422 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235561 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235821 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.235947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236081 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.connection = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.236990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.external = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.237902 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.mapped = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238029 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238180 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238575 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.password = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.238866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239004 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] auth.token = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239264 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] catalog.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239796 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.239796 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240031 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240031 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240274 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240667 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.240945 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.241331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.242504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.243641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.244698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.245645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.245645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.245645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.245645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.246117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.246117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.246375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.246375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.246612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.246901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.247164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.247444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.247692 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.247938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.248186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.248432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.248670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.248914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.249160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.249405 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.249662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.249901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.250157 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.250410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.250650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.250929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.251185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.251421 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.251663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.251900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.password = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.252143 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.252386 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.252637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.252878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.253123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.253378 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.253631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.253868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.254102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.254358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.254632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.254903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.255148 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.255391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.255628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.255873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.256138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.256377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.256634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.256889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.257143 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.257385 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.257621 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.259904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.261650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.262010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.262144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] policy.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.262316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.262568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.262859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.263074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] receipt.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.263317 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.263570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.263817 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.264056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.264298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.264591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.264804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.265057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.265297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.265567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.265824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.266065 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] revoke.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.266836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.267083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.268888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] role.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.268888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] role.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.269756 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.269905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] role.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.270183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] role.list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.270462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.271583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.271583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.271583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.271583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.271583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.272182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.272182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.272425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.272548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.272780 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.273022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.273285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.273545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.273791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.274031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.274269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.274511 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.274769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.275052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.275309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.275553 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.275795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.276033 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.276276 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.276519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.276772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.provider = fernet {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.276963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.277103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.277262 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.277518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.277762 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.278011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.278259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.278512 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] trust.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.278757 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.279022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.279263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.279517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.279777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.280013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.280260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.280568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.280846 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.connection = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.281096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.281349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.281593 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.282446 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.282694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.282964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.283206 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.283450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.283701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.283944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.284194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.284435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.284694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.284934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.285183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.285420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.285675 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.285916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:36:10.286089 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:36:10.305967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.306196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.311417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.311655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.311886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.322522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.341884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.342115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.364881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.381440 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.416556 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.416787 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.419246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.419486 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.482833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483341 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483431 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483871 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.483970 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.484088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.507320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.507546 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.507647 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.507775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.507882 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.507982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508299 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508415 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.508867 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.520495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.520632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.533504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.533742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.533973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.534202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.534423 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.534637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.534876 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.534981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.535129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.535353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.535576 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.535793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.536010 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.536223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:36:10.552134 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.552349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:36:10.552449 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.552577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:36:10.552673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.552879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:36:10.552974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553100 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:36:10.553199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553470 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.553979 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.554133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.566062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.566338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.566608 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.566913 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.567234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.567515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.567786 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.568071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.575134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.577132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.578424 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.579246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.579542 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.579928 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.580209 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.580469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.580739 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.581285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581656 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.581949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.582237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.582504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.582780 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.583087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.583362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.583641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.583913 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.608629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.610264 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.610619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.611001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.612653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.612937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.616366 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.616593 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.616869 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.618264 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.618544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.618847 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.624290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.624570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.626760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.627063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.629722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.630008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.630289 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.630570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.630867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.631143 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.631409 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.631673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.631824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.632020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.632304 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.632589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.632864 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.633141 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.633412 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.633681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.650989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.651271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.653059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.653339 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.655797 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.657939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.659469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.659761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.661645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.661942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.664802 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.666979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.668395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.670585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.672212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.673048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.673328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.673608 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.673880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.674188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.674937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.675240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.675527 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.675812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.676089 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.676367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.693728 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.694100 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.694366 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.694631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.696008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.696389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.696662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.696939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.702684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.704483 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.704752 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.705019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.706774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.707073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.707833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.708112 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.708392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.708671 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.708947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.710425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.710706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.711027 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.711308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.722425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.722704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.723008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.723296 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.723586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.723860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.724147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.724867 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.725151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.725435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.725717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.726000 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.726285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.726564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.743161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.745662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.746490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.749010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.749809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.752062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.752923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.753721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.754005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.754290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.754560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.756252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.756545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.756829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.761874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.763535 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.764360 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.765992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.766894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.767184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.767463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.767733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.769326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.769617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.769903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.770179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.777024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.777310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.777589 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.779540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.779831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.780113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.785565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=206999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.785844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.786129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.786404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.786676 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.786989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.787261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.787525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.787791 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.788056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.788199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=206998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:36:10.788344 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.788485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.788620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.788754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.788894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.789038 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.789189 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=206999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.789325 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.789467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.789736 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.790009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.790279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.790556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.790854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.791142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.791421 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.791690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=206998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:36:10.829617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55766cd419c0 pid: 206999 (default app) May 19 14:36:10.831948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55766cd419c0 pid: 206998 (default app) May 19 14:36:10.832998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a8ca-4d91-470b-9670-e1ef6b977725 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:10.833293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a8ca-4d91-470b-9670-e1ef6b977725 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:10.833570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a8ca-4d91-470b-9670-e1ef6b977725 None None] PATH_INFO: `/v3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:10.837838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu May 19 14:36:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:18.803361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:18.803965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:18.803965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:18.808377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:18.814112 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:18.814546 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:18.814663 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:18.882910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: INFO dbcounter [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] Registered counter for database keystone May 19 14:36:18.905037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG oslo_db.sqlalchemy.engines [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=206999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:36:18.911318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writer thread running {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:36:19.087155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG passlib.handlers.bcrypt [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=206999) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:36:19.087508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG passlib.handlers.bcrypt [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=206999) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:36:19.143087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:19.144676 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:19.270475 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 14:36:19.293649 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:19.363852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: INFO dbcounter [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] Registered counter for database keystone May 19 14:36:19.383468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG oslo_db.sqlalchemy.engines [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=206998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:36:19.389719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writer thread running {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:36:19.510919 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d006-9497-491d-95d3-8c0b813e921b None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:19.515288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24cf476ac4ff41ea8154c8b198b8ae32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:19.515954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:19.516273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:19.516548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:19.524704 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:19.576591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:36:19.576948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb612a83-df6b-48d8-8726-bb33f09d4b4a admin admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:19.588378 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:36:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:36:19.595021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:19.609656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ccd3e-a8de-4b71-bf97-895138455c31 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:19.614917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24cf476ac4ff41ea8154c8b198b8ae32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:19.615969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:19.616255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:19.616528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] PATH_INFO: `/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:19.618044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] RBAC: Authorizing `identity:get_project(project_id=24cf476ac4ff41ea8154c8b198b8ae32)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:19.777691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: WARNING keystone.common.rbac_enforcer.enforcer [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:36:19.778030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f02c-48fd-4bf9-9df2-0cab3647649a admin admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:19.783357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu May 19 14:36:19 2022] GET /identity/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:21.983528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad9fd-4afa-47a9-9612-f4ebc64aa836 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:21.984088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad9fd-4afa-47a9-9612-f4ebc64aa836 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:21.984088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad9fd-4afa-47a9-9612-f4ebc64aa836 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:21.988842 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:21.995044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:21.995440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:21.995597 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:22.014710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:22.016289 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:22.024189 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 14:36:22.045816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad9fd-4afa-47a9-9612-f4ebc64aa836 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:22.058474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad9fd-4afa-47a9-9612-f4ebc64aa836 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:22.062822 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e688e-3335-4efe-a60d-d08a51e32d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24cf476ac4ff41ea8154c8b198b8ae32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:22.063443 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e688e-3335-4efe-a60d-d08a51e32d1b admin admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:22.063735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e688e-3335-4efe-a60d-d08a51e32d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:22.064019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e688e-3335-4efe-a60d-d08a51e32d1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:22.072710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e688e-3335-4efe-a60d-d08a51e32d1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:22.074474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e688e-3335-4efe-a60d-d08a51e32d1b admin admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:22.083686 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:36:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:36:22.089172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:22.098210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f2f74-7244-40c2-a2a5-c27722367f34 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:22.102558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba46c9-39c3-4795-b196-d80c68a5594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24cf476ac4ff41ea8154c8b198b8ae32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:22.103455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba46c9-39c3-4795-b196-d80c68a5594d admin admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:22.103744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba46c9-39c3-4795-b196-d80c68a5594d admin admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:22.104017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba46c9-39c3-4795-b196-d80c68a5594d admin admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:22.105404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba46c9-39c3-4795-b196-d80c68a5594d admin admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:22.107527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba46c9-39c3-4795-b196-d80c68a5594d admin admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:22.109083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu May 19 14:36:22 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:24.407378 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff4fd-1826-4a55-b7b1-fa9676f67b5e None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.407948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff4fd-1826-4a55-b7b1-fa9676f67b5e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.407948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff4fd-1826-4a55-b7b1-fa9676f67b5e None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.409305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:24.415012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.415431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.415734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.430839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba053-51d6-48b7-84fd-d596b94c52e3 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.431131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba053-51d6-48b7-84fd-d596b94c52e3 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.431412 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba053-51d6-48b7-84fd-d596b94c52e3 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.432769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:24.433357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:24.434550 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:24.437852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.438147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.438432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.478839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG passlib.handlers.bcrypt [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=206998) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:36:24.479279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG passlib.handlers.bcrypt [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=206998) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:36:24.514911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:24.526572 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:24.528176 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:24.537874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:24.561377 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:24.630901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:24.644698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ecfb-d99e-4854-baa5-1904a48b0b0f None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:24.652441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:24.680545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:24.681427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.681715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.681994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.693048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:24.704198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:24.705277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:24.706181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:36:24.712924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:24.753739 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489e020-8ffa-4198-8e8c-e084ab68c2f8 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:24.756044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:24.791817 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:24.792639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.792925 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.793201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.794679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:24.813371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a130f4e-4cc1-4389-991a-2957b9ac1234 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:24.847213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:24.847885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:24.848173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:24.848454 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:24.849214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:24.849525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:24.850965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:24.860041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:24.862148 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:24.863525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:24.869199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:24.958298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:36:24.963766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:24.966427 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:24.967554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5552c-320c-469d-a903-f9c3aa1188f0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:25.003241 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:25.004124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:25.004411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:25.004685 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:25.006115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:25.007635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:25.009267 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:24 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:25.014843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:25.030475 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:25.075831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e7af-51af-4d8b-b9b5-381496fb6543 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:25.109688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:25.110479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:25.110759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:25.111088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:25.115989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90b589-49d3-457a-bc06-c7072271c45f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:25.129502 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:25.130998 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:25.151331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:36:25.151999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:25.153021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:25.154047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:36:25.154047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:36:25.154047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:36:25.154047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:36:25.154288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:25.154288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:25.154288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:25.154479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:36:25.154553 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:25.155320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:25.157070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:25.162909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:25.163042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:25.221284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:25.244832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:25.265635 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac9b01-9dd0-4e13-8382-82f58820caea None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:25.267126 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7475b2-1210-48bf-b1be-8021c5e9f73c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:25.303294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:25.303964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:25.304250 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:25.304526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:25.305370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.domain.id=default, user.id=36e70edefbb144ebbbd97da5f321c823) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:25.305680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:25.307220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35ecd-f583-4141-abbd-6f21c3974773 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:25.315336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:36:25 2022] GET /identity/v3/role_assignments?user.id=36e70edefbb144ebbbd97da5f321c823&scope.domain.id=default&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:25.442056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:25.442727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:25.443037 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:25.443310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:25.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:25.444382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:25.445842 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996beeb-c6b3-4529-9ae6-2f46c50749dc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:25.467415 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:28.180716 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fcbd3-536e-47a4-a414-59498a814f97 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.181795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fcbd3-536e-47a4-a414-59498a814f97 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.182301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fcbd3-536e-47a4-a414-59498a814f97 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.183945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:28.189737 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362067-937c-40cf-af1f-bf45d48c5bc3 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.190746 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362067-937c-40cf-af1f-bf45d48c5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.191447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362067-937c-40cf-af1f-bf45d48c5bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.220133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-ae362067-937c-40cf-af1f-bf45d48c5bc3 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:28.222479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-ae362067-937c-40cf-af1f-bf45d48c5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:28.322447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:28.359187 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fcbd3-536e-47a4-a414-59498a814f97 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:28.444202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf6d0-c1e8-4c66-b6f7-46165a368767 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.444834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf6d0-c1e8-4c66-b6f7-46165a368767 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.445359 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf6d0-c1e8-4c66-b6f7-46165a368767 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.446978 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:28.452118 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.452675 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.453165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.471020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:28.472528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:28.505131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fcbd3-536e-47a4-a414-59498a814f97 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:28.527132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:28.572580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:28.593000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:28.593816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.594103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.594381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.610755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:28.613863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:28.615434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:28.621691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-eabffc32-274a-49a7-ba04-b3e190938c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:36:28.652028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:28.652994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:28.653882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:36:28.653882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:36:28.653882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:36:28.653882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:28.653882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 13/26] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:28.656983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556d09f-517d-4a38-b899-bff47438ea7d None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.656983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556d09f-517d-4a38-b899-bff47438ea7d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.656983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556d09f-517d-4a38-b899-bff47438ea7d None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.656983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 14/27] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:28.657922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47601-f9ee-48d2-bd07-c490511ba7c0 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.658218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47601-f9ee-48d2-bd07-c490511ba7c0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.658497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47601-f9ee-48d2-bd07-c490511ba7c0 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.659765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 15/28] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:28.664276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d390d-84e5-4349-94f4-3f86f0eae4d7 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.664639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d390d-84e5-4349-94f4-3f86f0eae4d7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.664925 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d390d-84e5-4349-94f4-3f86f0eae4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.683974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-f51d390d-84e5-4349-94f4-3f86f0eae4d7 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:28.685335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-f51d390d-84e5-4349-94f4-3f86f0eae4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:28.750885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816226-fe0e-4d96-8106-d3825f55eb57 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:28.769400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 16/29] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:28.771045 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.771439 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.771813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.788896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:28.789840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:28.790326 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:28.790514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:28.790824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:28.791114 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:28.791881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:28.793404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:28.866027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 17/30] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:28.867046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:28.921107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 14/31] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:36:28 2022] POST /identity/v3/roles => generated 225 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:36:28.922142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:28.930161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:28.967965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:28.987572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63116a8-253a-4a8f-824f-d011bc7a205b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.030668 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.031560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.031847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.032126 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.032982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:29.033305 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.035060 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.048814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62bc8-8e89-4f99-934e-36eda199c2b1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.056713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 18/32] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:29.057658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:29.094508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.095255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.095586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.095875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.096658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.098255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.117725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 15/33] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:36:28 2022] POST /identity/v3/roles => generated 219 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:29.118453 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:29.239196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52a63-acd8-466f-9579-1edb1318bbb4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.289097 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:29.309224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:29.312545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccdc12-998f-43e2-9a2e-569f080e98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.313439 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccdc12-998f-43e2-9a2e-569f080e98b4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.313725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccdc12-998f-43e2-9a2e-569f080e98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.314084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccdc12-998f-43e2-9a2e-569f080e98b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.317981 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd81627-70fe-4890-9fae-73cef1a12be3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.329065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccdc12-998f-43e2-9a2e-569f080e98b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f0ccdc12-998f-43e2-9a2e-569f080e98b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:29.339118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:29.341403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 19/34] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:29.343464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de1802-edcb-4ae4-a822-88d2b2775c3d None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.345348 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de1802-edcb-4ae4-a822-88d2b2775c3d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.345348 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de1802-edcb-4ae4-a822-88d2b2775c3d None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.350359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 20/35] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:29.351192 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de1802-edcb-4ae4-a822-88d2b2775c3d None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:29.360795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274b3e0-f362-4b96-ba4c-d6b9eb9be6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.362051 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274b3e0-f362-4b96-ba4c-d6b9eb9be6cd None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.362465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274b3e0-f362-4b96-ba4c-d6b9eb9be6cd None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.362756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274b3e0-f362-4b96-ba4c-d6b9eb9be6cd None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.363807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274b3e0-f362-4b96-ba4c-d6b9eb9be6cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.365458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274b3e0-f362-4b96-ba4c-d6b9eb9be6cd None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.409546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 16/36] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:36:29 2022] POST /identity/v3/projects => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:29.411667 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.411904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.412205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.435819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:29.437671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:29.499620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de1802-edcb-4ae4-a822-88d2b2775c3d None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.532518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 17/37] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:29.548917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.549513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.549807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.550091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.550915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:29.551232 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.552676 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.560875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:29.563139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 21/38] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:29.569081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:29.615826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:29.654942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:29.684035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc4b84-941a-41a5-b8ff-249b65449a99 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.712030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4f922-cf48-4823-bbd0-efd45969a034 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.727568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.728247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.728573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.728805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.730005 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.731001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.749879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 18/39] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:36:29 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:36:29.764997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.764997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.764997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.764997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.766520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.768947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.771169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 22/40] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:29 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:29.777169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:29.889984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c198d2-5ea6-42b5-bb05-ca118dda0abe None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:29.927844 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5220c-c4a1-4219-b465-5dc771548359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:29.928675 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5220c-c4a1-4219-b465-5dc771548359 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:29.928958 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5220c-c4a1-4219-b465-5dc771548359 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:29.929235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5220c-c4a1-4219-b465-5dc771548359 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:29.930579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5220c-c4a1-4219-b465-5dc771548359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:29.932126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5220c-c4a1-4219-b465-5dc771548359 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:29.933932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 19/41] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:29.940387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:30.046254 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97caa77-3fec-429b-a345-97bd16976865 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:30.053497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:30.082132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:30.083040 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:30.083322 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:30.083603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] PATH_INFO: `/v3/domains/default/users/36e70edefbb144ebbbd97da5f321c823/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:30.085640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=36e70edefbb144ebbbd97da5f321c823, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:30.087153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:30.123873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28b7c-699d-415b-8753-27eea077b696 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:30.124160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28b7c-699d-415b-8753-27eea077b696 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:30.124440 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28b7c-699d-415b-8753-27eea077b696 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:30.125844 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 20/42] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:30.133207 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:30.133641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:30.134107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:30.147196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:30.152778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:30.154164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:30.203746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 23/43] 10.222.0.71 () {58 vars in 1361 bytes} [Thu May 19 14:36:29 2022] PUT /identity/v3/domains/default/users/36e70edefbb144ebbbd97da5f321c823/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:36:30.221134 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 21/44] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:30.246085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:30.357365 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b038685-1b77-4e97-99dc-b1fbf9247402 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:30.396027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cde0e7-e668-4dd4-aacc-5542e5750cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:30.396831 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cde0e7-e668-4dd4-aacc-5542e5750cf0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:30.397117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cde0e7-e668-4dd4-aacc-5542e5750cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:30.397452 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cde0e7-e668-4dd4-aacc-5542e5750cf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:30.398673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cde0e7-e668-4dd4-aacc-5542e5750cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:30.400363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cde0e7-e668-4dd4-aacc-5542e5750cf0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:30.404885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 24/45] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:30.410417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:30.510298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eb06-d5aa-483e-a8ab-c4273700f545 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:30.545752 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc7b2d-eaf7-4df8-9112-ebe957244d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:30.546417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7b2d-eaf7-4df8-9112-ebe957244d1a None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:30.546708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7b2d-eaf7-4df8-9112-ebe957244d1a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:30.547022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7b2d-eaf7-4df8-9112-ebe957244d1a None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:30.547745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc7b2d-eaf7-4df8-9112-ebe957244d1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:30.549765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc7b2d-eaf7-4df8-9112-ebe957244d1a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:30.553884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:30.574338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 22/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:36:30 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:32.430121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2847d-cf0e-4749-9d40-320a19d3e141 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:32.430627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2847d-cf0e-4749-9d40-320a19d3e141 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:32.430714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2847d-cf0e-4749-9d40-320a19d3e141 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:32.432296 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 25/47] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:32.437374 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:32.437809 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:32.437936 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:32.465562 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:32.466810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:32.532163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 23/48] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:32.555470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2847d-cf0e-4749-9d40-320a19d3e141 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:32.591080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:32.665689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2847d-cf0e-4749-9d40-320a19d3e141 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:32.698585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2889-43dc-42c7-bc98-7fbaba70d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:32.699407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2889-43dc-42c7-bc98-7fbaba70d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:32.699703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2889-43dc-42c7-bc98-7fbaba70d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:32.699988 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2889-43dc-42c7-bc98-7fbaba70d4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:32.710666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2889-43dc-42c7-bc98-7fbaba70d4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-40ab2889-43dc-42c7-bc98-7fbaba70d4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:32.718293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:32.719259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:32.720280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 26/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:32.726018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:32.801340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0abc9-69d0-4c14-8ae9-9393e945a1ab None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:32.801561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0abc9-69d0-4c14-8ae9-9393e945a1ab None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:32.801850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0abc9-69d0-4c14-8ae9-9393e945a1ab None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:32.803291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 27/50] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:32.808233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:32.808528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:32.808812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:32.825550 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379af78-1c52-4bf6-8287-f3b3e090b0a5 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:32.826266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:32.827920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:32.843947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:32.862379 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:32.863083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:32.863376 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:32.863658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:32.864421 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:32.864733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:32.866128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:32.878204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 24/51] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:32.883678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:32.897459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 28/52] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:32.920446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:32.944991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:32.985924 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a0ae6-e97c-41fb-ae4e-3a652bc45161 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:33.019769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c16ee1-9f9c-4559-973c-d5764c87a505 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:33.020640 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:33.021523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:33.021807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:33.022090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:33.023622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:33.025077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:33.026819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 25/53] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:32 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:33.032159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:33.053362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:33.054091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:33.054380 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:33.054659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:33.055889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:33.057425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:33.059121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 29/54] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:33.065026 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:33.079314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:33.130336 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014489-31a4-4f60-a255-3a8b1c2b6842 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:33.154629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:33.163451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b019-5f43-4090-9567-7d58a0e2dc30 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:33.163606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:33.164305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:33.164596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:33.164877 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:33.166076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:33.167564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:33.169366 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 26/55] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:33.176091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:33.198521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f4192-3f11-4379-932f-58fc966968e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:33.199227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f4192-3f11-4379-932f-58fc966968e2 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:33.199518 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f4192-3f11-4379-932f-58fc966968e2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:33.199818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f4192-3f11-4379-932f-58fc966968e2 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:33.200531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f4192-3f11-4379-932f-58fc966968e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:33.202002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f4192-3f11-4379-932f-58fc966968e2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:33.228343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 30/56] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:36:33 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:33.284142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04ee6e-7005-4203-9497-480380102e85 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:33.302514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:33.322696 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:33.323314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:33.323605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:33.323887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:33.324762 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.domain.id=default, user.id=36e70edefbb144ebbbd97da5f321c823) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:33.325077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:33.326580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431876f3-d93d-49b4-b1b3-bf059cbdbd64 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:33.336664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 27/57] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:36:33 2022] GET /identity/v3/role_assignments?user.id=36e70edefbb144ebbbd97da5f321c823&scope.domain.id=default&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:35.484857 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2aa587-67c0-400b-b8ce-41853ffe0a88 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:35.485416 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2aa587-67c0-400b-b8ce-41853ffe0a88 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:35.485522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2aa587-67c0-400b-b8ce-41853ffe0a88 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:35.486881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 31/58] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:35.491977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887435e4-1795-4511-b247-edaea48adcfd None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:35.492396 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887435e4-1795-4511-b247-edaea48adcfd None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:35.492543 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887435e4-1795-4511-b247-edaea48adcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:35.508904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-887435e4-1795-4511-b247-edaea48adcfd None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:35.510207 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-887435e4-1795-4511-b247-edaea48adcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:35.575605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 28/59] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:35.600688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2aa587-67c0-400b-b8ce-41853ffe0a88 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:35.700982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2aa587-67c0-400b-b8ce-41853ffe0a88 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:35.734226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922b250-397a-4ccc-9b31-8cabdc8b9f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:35.735034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922b250-397a-4ccc-9b31-8cabdc8b9f1c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:35.735323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922b250-397a-4ccc-9b31-8cabdc8b9f1c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:35.735600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922b250-397a-4ccc-9b31-8cabdc8b9f1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:35.736794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922b250-397a-4ccc-9b31-8cabdc8b9f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:35.738269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922b250-397a-4ccc-9b31-8cabdc8b9f1c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:35.739909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 32/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:35.745345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887435e4-1795-4511-b247-edaea48adcfd None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:35.842234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887435e4-1795-4511-b247-edaea48adcfd None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:35.853380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:35.877265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725a128-451c-4a93-b70c-152ae4d01c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:35.877926 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725a128-451c-4a93-b70c-152ae4d01c52 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:35.878213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725a128-451c-4a93-b70c-152ae4d01c52 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:35.878493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725a128-451c-4a93-b70c-152ae4d01c52 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:35.879246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725a128-451c-4a93-b70c-152ae4d01c52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:35.880716 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725a128-451c-4a93-b70c-152ae4d01c52 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:35.905966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 29/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:36:35 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:39.269850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688364-3ba9-4a96-a9fb-e903a9837532 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.270376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688364-3ba9-4a96-a9fb-e903a9837532 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.270482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688364-3ba9-4a96-a9fb-e903a9837532 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.271835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 33/62] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:39.287932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffe6de-8a4f-47ca-9882-b28481786f4f None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.288410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffe6de-8a4f-47ca-9882-b28481786f4f None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.288493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffe6de-8a4f-47ca-9882-b28481786f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.316213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-14ffe6de-8a4f-47ca-9882-b28481786f4f None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:39.317183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-14ffe6de-8a4f-47ca-9882-b28481786f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:39.421164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 30/63] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:39.462576 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688364-3ba9-4a96-a9fb-e903a9837532 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:39.483801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:39.620748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688364-3ba9-4a96-a9fb-e903a9837532 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:39.623637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97713-4477-4926-acf2-ad7943f75e1c None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.623931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97713-4477-4926-acf2-ad7943f75e1c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.624208 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97713-4477-4926-acf2-ad7943f75e1c None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.625779 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 31/64] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:39.632652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889a0b-5beb-4765-a961-64bf19c048b1 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.632931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889a0b-5beb-4765-a961-64bf19c048b1 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.633218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889a0b-5beb-4765-a961-64bf19c048b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.655722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-55889a0b-5beb-4765-a961-64bf19c048b1 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:39.656960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-55889a0b-5beb-4765-a961-64bf19c048b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:39.696492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:39.697297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.697584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.697860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.716329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:39.724169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:39.725130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:39.725955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 34/65] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:39.737343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:39.785219 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 32/66] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:39.787711 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962dec3-227b-4c8e-9728-c16fe87897de None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.788232 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962dec3-227b-4c8e-9728-c16fe87897de None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.788726 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962dec3-227b-4c8e-9728-c16fe87897de None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.790213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 33/67] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:39.791916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fdc1b-85a5-40b5-994d-cc9590303677 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.792413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fdc1b-85a5-40b5-994d-cc9590303677 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.793244 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fdc1b-85a5-40b5-994d-cc9590303677 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.795023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 34/68] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:39.796564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac33b2-4a9d-4c7d-bd55-d650ddbe847b None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.797227 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac33b2-4a9d-4c7d-bd55-d650ddbe847b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.797684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac33b2-4a9d-4c7d-bd55-d650ddbe847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.820835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-b7ac33b2-4a9d-4c7d-bd55-d650ddbe847b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:39.822607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:39.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-b7ac33b2-4a9d-4c7d-bd55-d650ddbe847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:39.846289 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:39.857234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b82a03-05b4-41f3-8939-31251bec03e5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:39.894271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:39.894895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.895185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.895463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.896219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:39.896523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:39.897922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:39.898108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 35/69] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:39.904849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:39.904849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:39.904849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:39.913438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 35/70] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:39.918950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:39.922289 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:39.925316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:40.004091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 36/71] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:40.005115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.042188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa848-4cd8-49d8-8723-826ef059f0cb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.084615 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.085420 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.085711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.085992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.088220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.099474 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:40.100298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:40.108807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:40.109795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:40.110624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 36/72] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:40.112608 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.124460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc740f-b8ff-4cc9-b5af-4be1e3ba22ef None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.161292 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.162088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.162373 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.162648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.179445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.180920 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.182654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 37/73] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:40.184244 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.215633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6596-25f7-45e5-b3b2-066b43ae7591 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.250081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.250932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.251225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.251527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.263890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:40.272055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:40.274466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 37/74] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:40.275395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.288032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29163b6a-ac96-4621-a69e-fe5785635945 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.325408 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59acec-6b3a-4431-8655-232d2c367f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.326527 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59acec-6b3a-4431-8655-232d2c367f30 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.326527 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59acec-6b3a-4431-8655-232d2c367f30 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.326752 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59acec-6b3a-4431-8655-232d2c367f30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.331585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.339223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59acec-6b3a-4431-8655-232d2c367f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-7b59acec-6b3a-4431-8655-232d2c367f30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:40.348684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:40.349960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:36:40.351115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 38/75] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:40.352524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b59a6-aaf0-49a6-a1d1-d38888d5f136 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.352524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b59a6-aaf0-49a6-a1d1-d38888d5f136 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.352524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b59a6-aaf0-49a6-a1d1-d38888d5f136 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.353748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 39/76] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:40.355681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b59a6-aaf0-49a6-a1d1-d38888d5f136 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.359547 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.383236 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67eb1-fabc-47d7-bf8f-7f08173eb1a3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.416673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.417273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.417563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.417844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.418592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:40.418935 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.420349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.429317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 38/77] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:40.430309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.458456 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b59a6-aaf0-49a6-a1d1-d38888d5f136 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.493220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495950d-4ea9-473d-93e8-f593e308c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.493885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495950d-4ea9-473d-93e8-f593e308c240 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.494224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495950d-4ea9-473d-93e8-f593e308c240 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.494505 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495950d-4ea9-473d-93e8-f593e308c240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.529821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7c5f-65e9-4513-84d1-6a05610076f4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.545612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.561468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495950d-4ea9-473d-93e8-f593e308c240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.562978 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495950d-4ea9-473d-93e8-f593e308c240 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.564117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.564773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.565067 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.565351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.565636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.566103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:40.566415 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.567846 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.575899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 39/78] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:40.576703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.670878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 40/79] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:40.675853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.675853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.675853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.691765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:40.692975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:40.693282 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd5a9-3562-478e-a574-836b003f36df None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.733848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.734523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.734835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.735124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.735878 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:40.736216 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.737621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.745755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 40/80] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:40.746561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.769413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 41/81] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:40.770278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.790853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.805342 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:40.850866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0392e28-b06a-421a-a542-7e65e0ee462b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.870832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368aae1-1ba2-4ad2-8ce1-879fc834758e None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:40.883362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.884233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.884520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.884795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.886008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.887504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.889312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 41/82] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:40.889978 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.905350 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:40.906233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:40.906522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:40.906838 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:40.908694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:40.910158 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:40.911838 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 42/83] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:40.912604 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:40.994266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fab60-8c77-4ece-9d0c-26ea2c93daf3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.004203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.013391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7b490-3c07-478e-9205-3abb67ce4eca None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.014968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.031230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.032101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.032387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.032667 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.033933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.035470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.037199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 42/84] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:41.037972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.059035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.060616 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.061007 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.061545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.063592 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.065786 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.067633 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 43/85] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:40 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:41.067633 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.152929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fe4a9-5b4a-4489-a1dc-5020e3978f46 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.175428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88daf79-be83-48e3-8ff2-d436b22275c2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.185086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.185873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.186166 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.186630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.187650 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.189648 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.191314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 43/86] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:41.192160 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.210449 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.211133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.211422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.211699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.240048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.249924 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.279216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.280695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.295585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b02d-d653-46a0-9abc-1b579293abdd None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.329652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.330948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.331131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.331411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.377732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 44/87] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:41.379426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.399344 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.400841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.444295 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.446139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.476161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5c27d-90c4-4c5b-96d2-5580114392cc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.498862 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 44/88] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:41.499897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.509996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.510614 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.510910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.511197 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.512050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=d07be9e7872649819e166ac1192258ae) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:41.512361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.513831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.519559 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 45/89] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/role_assignments?user.id=d07be9e7872649819e166ac1192258ae&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=2816caba47884002a96dab7b07f4bac4 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:41.520321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.613866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cbc09-7892-4ec9-927d-8c9f11934cf1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.637093 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4d83f-a502-4705-9881-983141215cbc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.652962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.653488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.653779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.654056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.669672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.679135 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.680135 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.680430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.680714 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.681634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.683885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.692190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.709875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 46/90] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:36:41 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:41.710754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.733777 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.737220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.864529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81532-af91-4d61-9af3-0553e163cf29 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:41.871246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 45/91] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:41.875732 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.918166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:41.919089 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:41.919376 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:41.919657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:41.920947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:41.922414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:41.927824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 47/92] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:41.927995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.928273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:41.998608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:41.999278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7cc0b-a626-4719-ab90-c7fa453d4080 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:42.051485 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:42.053123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:42.053123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:42.053123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:42.054117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:42.055642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:42.057512 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 46/93] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:42.058076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68990f85-2650-4bbe-a909-36f67073cb09 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:42.058991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:42.105282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:42.106158 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:42.106443 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:42.106722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] PATH_INFO: `/v3/projects/bf9e41c35eee440ca600a8e13c64bd61` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:42.109449 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] RBAC: Authorizing `identity:get_project(project_id=bf9e41c35eee440ca600a8e13c64bd61)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:42.110984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:42.113292 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 48/94] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:41 2022] GET /identity/v3/projects/bf9e41c35eee440ca600a8e13c64bd61 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:42.114155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:42.185347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e830a-20c0-4b8a-a5b3-a2e9b2861ebf None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:42.200089 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:42.228397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:42.229337 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:42.229629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:42.229910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:42.231036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=36e70edefbb144ebbbd97da5f321c823) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:42.231360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:42.233804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:42.238692 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd473-8640-4ae9-9d88-8ba94d0017d0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:42.240936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 47/95] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:42 2022] GET /identity/v3/role_assignments?user.id=36e70edefbb144ebbbd97da5f321c823&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:42.242686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:42.269811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:42.281247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:42.282203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:42.282772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:42.283784 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:42.284872 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] RBAC: Adding query filter params (role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=d07be9e7872649819e166ac1192258ae) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:42.285362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:42.287487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f323-15aa-4735-8238-f6583d24092f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:42.299295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 49/96] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:42 2022] GET /identity/v3/role_assignments?user.id=d07be9e7872649819e166ac1192258ae&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:42.393233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd5f01-7c40-4ac7-b5c2-0993733ff71c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:42.436197 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:42.436772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:42.437059 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:42.437339 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:42.438208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=bf9e41c35eee440ca600a8e13c64bd61, user.id=d07be9e7872649819e166ac1192258ae) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:42.438519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:42.440164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fee76d-75b3-4ddf-adef-272679bb7ec6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:42.447222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 48/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:42 2022] GET /identity/v3/role_assignments?user.id=d07be9e7872649819e166ac1192258ae&scope.project.id=bf9e41c35eee440ca600a8e13c64bd61&role.id=2816caba47884002a96dab7b07f4bac4 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:44.459477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faf18a-95b6-4d5a-828f-610c496dcc0c None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:44.460025 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faf18a-95b6-4d5a-828f-610c496dcc0c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:44.460025 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faf18a-95b6-4d5a-828f-610c496dcc0c None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:44.461402 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 50/98] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:44.466622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:44.467161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:44.467255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:44.484681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:44.486407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:44.523612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:44.558204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 49/99] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:44.582421 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faf18a-95b6-4d5a-828f-610c496dcc0c None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:44.695966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faf18a-95b6-4d5a-828f-610c496dcc0c None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:44.738941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:44.739799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:44.740141 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:44.740420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:44.763149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:44.770916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:44.771939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:36:44.772889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 51/100] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:44.783572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:44.910717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45d120-c362-4518-9c60-97c33c0b32a4 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:44.954773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:44.955901 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:44.956426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:44.956937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:44.957937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:44.958469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:44.960166 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9192e-19b4-4b5f-a79b-97bd6d48236f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:44.975399 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 50/101] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:44.980650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:45.068238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:45.129990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7d38-1e92-4795-b614-fb6f91bb637f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:45.163768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c755-85ec-4f6d-8250-a3560acbee70 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.164467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c755-85ec-4f6d-8250-a3560acbee70 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.164983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c755-85ec-4f6d-8250-a3560acbee70 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.166720 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 51/102] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:45.173133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a87cf-55fb-4ac6-85b4-86f82182129b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.174242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a87cf-55fb-4ac6-85b4-86f82182129b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.175273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a87cf-55fb-4ac6-85b4-86f82182129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.179194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:45.180952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.182665 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.183195 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.185479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:45.187451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:45.190387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 52/103] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:44 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:45.203740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:45.226434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-d66a87cf-55fb-4ac6-85b4-86f82182129b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:45.228054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-d66a87cf-55fb-4ac6-85b4-86f82182129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:45.293223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:45.387603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 52/104] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:45.389525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30fd7-0bf3-4421-ba08-9a40dc5b04e1 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.391493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1847dde-e5fb-47c9-bcfb-ec946d422fa8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:45.392036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30fd7-0bf3-4421-ba08-9a40dc5b04e1 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.393091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30fd7-0bf3-4421-ba08-9a40dc5b04e1 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.396369 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 53/105] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:45.407054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade39d9-eb4a-4ee6-a58d-d57b8b6a2de9 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.407653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade39d9-eb4a-4ee6-a58d-d57b8b6a2de9 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.408714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade39d9-eb4a-4ee6-a58d-d57b8b6a2de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.432687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:45.436682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-7ade39d9-eb4a-4ee6-a58d-d57b8b6a2de9 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:45.439245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-7ade39d9-eb4a-4ee6-a58d-d57b8b6a2de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:45.463780 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:45.465307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.465797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.466265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.467950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:45.469609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:45.472158 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 53/106] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:45 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:45.473165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:45.540338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 54/107] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:45.547306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0b9ae-be50-488a-b739-190691f572ab None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.547306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0b9ae-be50-488a-b739-190691f572ab None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.547306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0b9ae-be50-488a-b739-190691f572ab None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.547306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 55/108] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:45.547306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0b9ae-be50-488a-b739-190691f572ab None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:45.633865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4214-dbb8-4456-a0bf-843dae7935e1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:45.664471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:45.678571 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0b9ae-be50-488a-b739-190691f572ab None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:45.684288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffacce-8db4-490a-bfb6-fd8e5c537896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:45.685368 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffacce-8db4-490a-bfb6-fd8e5c537896 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.685893 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffacce-8db4-490a-bfb6-fd8e5c537896 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.686834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffacce-8db4-490a-bfb6-fd8e5c537896 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.701061 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffacce-8db4-490a-bfb6-fd8e5c537896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-58ffacce-8db4-490a-bfb6-fd8e5c537896 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:45.711884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:45.712840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:36:45.713713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:36:45.716033 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 54/109] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:45.716625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:45.717682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.717883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.718185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.718494 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:45.718617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/d07be9e7872649819e166ac1192258ae/roles/2816caba47884002a96dab7b07f4bac4` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.719059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:45.722095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f3c82497249eabf902ceb21d001b3, user_id=d07be9e7872649819e166ac1192258ae, role_id=2816caba47884002a96dab7b07f4bac4)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:45.723841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:45.740381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:45.741082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 56/110] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:36:45 2022] PUT /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/d07be9e7872649819e166ac1192258ae/roles/2816caba47884002a96dab7b07f4bac4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:36:45.742073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:45.742214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:45.792561 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:45.821562 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 55/111] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:45.822708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:45.909404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240262f6-35f0-4e8d-b0e5-bc38a47d9ddd None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:45.971671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6ebf2-bcc4-4ece-9d14-44e964bb7aa2 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:45.998055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:45.999158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:45.999768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.000301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.001739 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.003601 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.006622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 57/112] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:46.012143 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.034137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.035627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.035627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.035627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.036158 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:46.036469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.037857 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.042897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.047544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 56/113] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:46.048622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.111943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.142764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaeb05-7372-4128-8509-d83b14dd6d5f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:46.179129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3c57-4f03-4f1c-a5e6-da7d9fb823a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.179990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3c57-4f03-4f1c-a5e6-da7d9fb823a5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.180203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3c57-4f03-4f1c-a5e6-da7d9fb823a5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.180481 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3c57-4f03-4f1c-a5e6-da7d9fb823a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.183396 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427ea1-0126-4731-9783-8cf8ade4ebbb None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:46.191334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b3c57-4f03-4f1c-a5e6-da7d9fb823a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-be8b3c57-4f03-4f1c-a5e6-da7d9fb823a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:46.199338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:46.200524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:46.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 58/114] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:46.202362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635866-9c85-44fb-8078-1537a121f9f8 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.202362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635866-9c85-44fb-8078-1537a121f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.202362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635866-9c85-44fb-8078-1537a121f9f8 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.203754 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 59/115] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:46.208903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635866-9c85-44fb-8078-1537a121f9f8 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.226568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.227510 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.227967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.228406 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.229381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.231095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.266850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 57/116] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:36:46 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:46.266850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.308945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.347990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635866-9c85-44fb-8078-1537a121f9f8 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:46.401025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b615190-32b1-4b4e-bcd5-068165950810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.402782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b615190-32b1-4b4e-bcd5-068165950810 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.403336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b615190-32b1-4b4e-bcd5-068165950810 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.403853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b615190-32b1-4b4e-bcd5-068165950810 None admin] PATH_INFO: `/v3/users/88e8478c1f7f4dc58f22820e29e8c918` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.408467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.426026 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a2431-a3e9-490f-97e1-16a0170c2cbc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:46.430653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b615190-32b1-4b4e-bcd5-068165950810 None admin] RBAC: Authorizing `identity:get_user(user_id=88e8478c1f7f4dc58f22820e29e8c918)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.432690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b615190-32b1-4b4e-bcd5-068165950810 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.434704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 60/117] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/users/88e8478c1f7f4dc58f22820e29e8c918 => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:46.441499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.441808 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.442061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.460652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:46.461359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:46.482290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.483581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.483878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.484162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.484931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:46.485244 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.487228 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec293-ba6e-41c5-b767-2603bccc5e0b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.497591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 58/118] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:46.499299 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587fb1-e968-4350-8ef9-79ba9fb908be None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.499590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587fb1-e968-4350-8ef9-79ba9fb908be None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.499865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587fb1-e968-4350-8ef9-79ba9fb908be None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.501258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 59/119] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:46.502408 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0587fb1-e968-4350-8ef9-79ba9fb908be None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.548857 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 61/120] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:46.550482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.623342 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0587fb1-e968-4350-8ef9-79ba9fb908be None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:46.661116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.662195 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.662744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.663345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.667130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.682511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a7b9-d7f3-42ac-8b1c-931e8ec29b6f None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:46.687230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.732960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28b532-5d0d-4af4-ad9e-2e3ac5ddcf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:46.734007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b532-5d0d-4af4-ad9e-2e3ac5ddcf32 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.734291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b532-5d0d-4af4-ad9e-2e3ac5ddcf32 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.734998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b532-5d0d-4af4-ad9e-2e3ac5ddcf32 None admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.736968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28b532-5d0d-4af4-ad9e-2e3ac5ddcf32 None admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.738434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28b532-5d0d-4af4-ad9e-2e3ac5ddcf32 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.742062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 62/121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:46.743396 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:46.743684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:46.743964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:46.747914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:46.749392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:46.765607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:46.767123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:46.853920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 63/122] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:46.855618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.863462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 60/123] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:46.864416 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:46.942604 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.947908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:46.998210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d626119-0514-49cf-8ecd-2df8a4ad07ba None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.014499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c072de7-7eec-4890-8b39-d7e525d79968 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.043050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.043876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.044160 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.044599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.058411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.059318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.059608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.059890 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.060871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:47.061427 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.062936 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.069548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 61/124] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:47.069809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:47.072073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:47.074092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:47.075370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.075468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 64/125] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:36:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:47.075468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.186150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260fefd-eb54-4853-9d5c-94a5d37f510f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.192428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f40a-ef53-4804-8264-304e7459daf1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.206580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:47.222404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.222710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:47.223474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.223826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.224233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.225852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.227532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.229725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 62/126] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:47.230635 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.238838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.239671 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.239962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.240245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.252018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:47.263807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:47.265511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 65/127] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:47.267104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.340566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8e3b9-180e-4271-a802-205ac501a52f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.373784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882c96-9cf8-4b71-ba40-2e641bd75eee None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.375606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.376694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.377047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.377393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/36e70edefbb144ebbbd97da5f321c823/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.379478 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f3c82497249eabf902ceb21d001b3, user_id=36e70edefbb144ebbbd97da5f321c823, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.381020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.400992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 63/128] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:36:47 2022] PUT /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/36e70edefbb144ebbbd97da5f321c823/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:36:47.401958 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.425543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.426339 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.426681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.427042 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.427814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:47.428124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.429624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.450584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 66/129] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:47.451363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.463620 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:47.543947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3406d12-6498-4f8b-af63-4a27edf7d907 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.576721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:47.600144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.600826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.601116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.601395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.602259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] RBAC: Adding query filter params (role.id=9afe1d161ebd4d80b0f0f62e206cacc9, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=88e8478c1f7f4dc58f22820e29e8c918) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:47.602575 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.604162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.612074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 64/130] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/role_assignments?user.id=88e8478c1f7f4dc58f22820e29e8c918&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=9afe1d161ebd4d80b0f0f62e206cacc9 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:47.613021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.741534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f5243-dffb-4862-a0da-9582f481a12f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.782815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.783519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.783806 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.784083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.784866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:47.785175 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.786630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.793829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad7259-9f8f-438b-a5b5-c28b9e6f8f85 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.797335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 67/131] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:47.801980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.821774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:47.860410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.861350 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.861637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.861912 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.863198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.864668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.866504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 65/132] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:47.872106 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:47.919311 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91ebb4-676a-45b5-bd67-32135af0f195 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:47.930998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:47.961338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:47.962221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:47.962504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:47.962776 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:47.965114 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:47.966596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:47.968381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 68/133] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:47.973804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:48.021605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdace8-deb9-4bb1-8ed5-7394d1e1597f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:48.073875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:48.079189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.080383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.080886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.082396 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:48.082583 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cddc4-f4be-41f4-b06b-b2002a33191d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:48.084270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:48.086261 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 66/134] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:48.092332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:48.119960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:48.120824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.121195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.121768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] PATH_INFO: `/v3/projects/bf9e41c35eee440ca600a8e13c64bd61` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.122734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] RBAC: Authorizing `identity:get_project(project_id=bf9e41c35eee440ca600a8e13c64bd61)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:48.124314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:48.126026 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 69/135] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:47 2022] GET /identity/v3/projects/bf9e41c35eee440ca600a8e13c64bd61 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:48.132252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:48.185942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:48.200800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:48.248348 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e83abe-102d-42af-a165-bcb4e06b284f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:48.284601 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fad501-b872-4204-bb61-8f4f4daebeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:48.285503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad501-b872-4204-bb61-8f4f4daebeae None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.285790 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad501-b872-4204-bb61-8f4f4daebeae None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.286074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad501-b872-4204-bb61-8f4f4daebeae None admin] PATH_INFO: `/v3/projects/bf9e41c35eee440ca600a8e13c64bd61/users/d07be9e7872649819e166ac1192258ae/roles/2816caba47884002a96dab7b07f4bac4` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.288167 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fad501-b872-4204-bb61-8f4f4daebeae None admin] RBAC: Authorizing `identity:create_grant(project_id=bf9e41c35eee440ca600a8e13c64bd61, user_id=d07be9e7872649819e166ac1192258ae, role_id=2816caba47884002a96dab7b07f4bac4)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:48.289688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fad501-b872-4204-bb61-8f4f4daebeae None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:48.305450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 70/136] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:36:48 2022] PUT /identity/v3/projects/bf9e41c35eee440ca600a8e13c64bd61/users/d07be9e7872649819e166ac1192258ae/roles/2816caba47884002a96dab7b07f4bac4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:36:48.331543 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85222dd-7912-4b0c-a5e3-5270ddff8d5d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:48.382120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95a2f-1ae7-4488-a48a-d883111b43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:48.383060 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95a2f-1ae7-4488-a48a-d883111b43e9 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.383345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95a2f-1ae7-4488-a48a-d883111b43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.383624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95a2f-1ae7-4488-a48a-d883111b43e9 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/d07be9e7872649819e166ac1192258ae/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.388470 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a95a2f-1ae7-4488-a48a-d883111b43e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f3c82497249eabf902ceb21d001b3, user_id=d07be9e7872649819e166ac1192258ae, role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:48.390084 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a95a2f-1ae7-4488-a48a-d883111b43e9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:48.417363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 67/137] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:36:48 2022] PUT /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/d07be9e7872649819e166ac1192258ae/roles/0cebdd5895894be58dd945aadfab5e3f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:36:48.615788 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff945af-3c14-4459-9104-04a4465ac031 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.616309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff945af-3c14-4459-9104-04a4465ac031 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.616309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff945af-3c14-4459-9104-04a4465ac031 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.617663 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 71/138] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:48.627287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.627828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.627828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.648008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:48.649255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:48.736444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 68/139] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:48.761003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff945af-3c14-4459-9104-04a4465ac031 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:48.884675 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff945af-3c14-4459-9104-04a4465ac031 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:48.892045 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:48.925624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d378-47fd-48fd-ab0c-d16e5ee1713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:48.926443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d378-47fd-48fd-ab0c-d16e5ee1713f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:48.926753 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d378-47fd-48fd-ab0c-d16e5ee1713f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:48.927949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d378-47fd-48fd-ab0c-d16e5ee1713f None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:48.939336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9d378-47fd-48fd-ab0c-d16e5ee1713f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-54d9d378-47fd-48fd-ab0c-d16e5ee1713f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:48.947536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:48.949902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:48.951940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 72/140] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:48.959332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:48.997128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:49.036001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90f417-bf95-49ff-9aaa-81638394b5aa None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.036331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90f417-bf95-49ff-9aaa-81638394b5aa None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.036608 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90f417-bf95-49ff-9aaa-81638394b5aa None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.038275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 73/141] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:49.043305 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.043702 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.043983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.071220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:49.072417 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:49.094934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f48b1e-c3f2-48a1-9e0e-d2eae905f560 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:49.156035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:49.156685 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.156971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.157297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.158629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:49.158968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:49.160631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:49.170379 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 69/142] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:49.176307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:49.288244 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf570c-b050-4a8f-bd33-a9627efd5e7e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:49.291131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:49.292171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 74/143] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:49.327880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:49.331790 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:49.332683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.332966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.333243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.334478 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:49.337295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:49.339353 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 70/144] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:49 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:49.345517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:49.453800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276806-533e-45f4-a991-f64ee1d48902 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:49.490581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:49.491570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.492022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.492456 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.521799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:49.539146 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:49.544779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd319b35-99ea-4f64-82ea-efd666806014 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:49.570163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:49.571938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:49.608358 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:49.609161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.609448 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.609725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.615514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:49.617020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:49.618698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 75/145] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:49.639777 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:49.682025 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 71/146] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:36:49.688137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:49.757939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:49.793354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a9fb-c4bf-45ac-8058-8d116fd92f36 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:49.822612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093dc70-f805-4d01-89a4-d8262059c9ad None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:49.830467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:49.831583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.832107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.832550 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.834020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:49.835643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:49.837595 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 72/147] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:49 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:49.843422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:49.891526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dbd2f-cc89-49da-9e35-a1001fa08c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:49.892342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dbd2f-cc89-49da-9e35-a1001fa08c2f None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:49.892640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dbd2f-cc89-49da-9e35-a1001fa08c2f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:49.892918 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dbd2f-cc89-49da-9e35-a1001fa08c2f None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:49.893818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dbd2f-cc89-49da-9e35-a1001fa08c2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:49.895321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dbd2f-cc89-49da-9e35-a1001fa08c2f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:49.956539 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 76/148] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:36:49 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:49.957656 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb84dc-b4a4-4be1-bbde-9615fe299f5e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:50.007844 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:50.008590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:50.008816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:50.009096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:50.010083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=d07be9e7872649819e166ac1192258ae) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:50.010401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:50.011955 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d3c5-2e40-4c97-8fad-12def228b31b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:50.020439 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:50.025385 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 73/149] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:49 2022] GET /identity/v3/role_assignments?user.id=d07be9e7872649819e166ac1192258ae&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=2816caba47884002a96dab7b07f4bac4 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:50.579412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580db6a-4456-4204-81c9-e6e46a2b73f6 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:50.580141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580db6a-4456-4204-81c9-e6e46a2b73f6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:50.580431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580db6a-4456-4204-81c9-e6e46a2b73f6 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:50.581835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 77/150] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:50.588350 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:50.588640 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:50.588921 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:50.611215 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:50.612747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:50.708512 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 74/151] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:50.734055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580db6a-4456-4204-81c9-e6e46a2b73f6 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:50.759248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:50.861107 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580db6a-4456-4204-81c9-e6e46a2b73f6 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:50.898123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7510e07-9d3d-497b-b602-b9556cedddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:50.898953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510e07-9d3d-497b-b602-b9556cedddd8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:50.899232 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510e07-9d3d-497b-b602-b9556cedddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:50.899503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510e07-9d3d-497b-b602-b9556cedddd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:50.910907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7510e07-9d3d-497b-b602-b9556cedddd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c7510e07-9d3d-497b-b602-b9556cedddd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:50.918782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:50.921356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:50.923569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 78/152] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:50.928129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:50.981735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da853-4808-4c04-a114-2124e62144bb None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:50.982426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da853-4808-4c04-a114-2124e62144bb None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:50.982881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da853-4808-4c04-a114-2124e62144bb None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:50.985133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 79/153] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:50.992637 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:50.993047 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:50.993478 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.019130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:51.020255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:51.049153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389ea87-1d9c-4df1-9b57-41b6c8ffac01 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.084910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.089196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.094995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.094995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.094995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.094995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:51.094995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.094995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.100210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 80/154] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:51.104744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 75/155] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:51.110523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.123765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.132344 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.218397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002df8-830f-40c1-b34a-05dcb60f08cb None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.247598 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d0be-ce3d-4cbb-bbbe-0c2b7b9c1655 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.271554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.272673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.272802 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.272994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] PATH_INFO: `/v3/users/36e70edefbb144ebbbd97da5f321c823` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.277742 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] RBAC: Authorizing `identity:get_user(user_id=36e70edefbb144ebbbd97da5f321c823)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.279280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.281289 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 81/156] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/users/36e70edefbb144ebbbd97da5f321c823 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:51.286633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.296878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.297934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.298986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.299443 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.311234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:51.320140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:51.321394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:36:51.322495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:36:51.324939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 76/157] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:51.330750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.389974 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.443788 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612d58-d6e4-460d-8aa9-d4d19678ab90 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.452564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b00af-8681-48e4-8f0b-f881221a3045 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.481862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.482829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.483123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.483404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.484161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:51.484470 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.486401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.496922 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 77/158] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:51.503209 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.507500 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.508173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.508456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.508733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.611442 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.612950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.620212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eda523-9951-4e91-bfb3-7b5aaefb1a97 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.655260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.661344 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.662290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.662585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.662899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] PATH_INFO: `/v3/users/88e8478c1f7f4dc58f22820e29e8c918` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.664162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] RBAC: Authorizing `identity:get_user(user_id=88e8478c1f7f4dc58f22820e29e8c918)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.665637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.667769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 78/159] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/users/88e8478c1f7f4dc58f22820e29e8c918 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:51.673376 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.719160 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.750325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 82/160] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:36:51.756523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.787986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346e149-2a9d-4f8d-aca7-a2dde4e31b5d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.825202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b02c1-76ae-4f8c-a6d0-2d26f5d8b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.826075 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b02c1-76ae-4f8c-a6d0-2d26f5d8b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.826362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b02c1-76ae-4f8c-a6d0-2d26f5d8b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.826639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b02c1-76ae-4f8c-a6d0-2d26f5d8b7f6 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.827927 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b02c1-76ae-4f8c-a6d0-2d26f5d8b7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.829414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b02c1-76ae-4f8c-a6d0-2d26f5d8b7f6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.831518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 79/161] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:51.837902 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e887002-6b7c-419b-9919-0176f45abdd5 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.838194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e887002-6b7c-419b-9919-0176f45abdd5 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.838534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e887002-6b7c-419b-9919-0176f45abdd5 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.840124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 80/162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:51.840700 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e887002-6b7c-419b-9919-0176f45abdd5 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:51.905993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e9710-d9fe-41a6-8b2d-3ca3ec2a3ec7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.916589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:51.956605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e887002-6b7c-419b-9919-0176f45abdd5 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:51.965397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e1f10-2a09-48f1-a5b6-2e7dd435a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.966265 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1f10-2a09-48f1-a5b6-2e7dd435a08d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.966541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1f10-2a09-48f1-a5b6-2e7dd435a08d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.966823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1f10-2a09-48f1-a5b6-2e7dd435a08d None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.971514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e1f10-2a09-48f1-a5b6-2e7dd435a08d None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.973128 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e1f10-2a09-48f1-a5b6-2e7dd435a08d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:51.974901 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 83/163] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:51 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:51.976077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.976356 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.976627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.993602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:51.994569 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:51.994891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:51.995233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/88e8478c1f7f4dc58f22820e29e8c918/roles/9afe1d161ebd4d80b0f0f62e206cacc9` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:51.997383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f3c82497249eabf902ceb21d001b3, user_id=88e8478c1f7f4dc58f22820e29e8c918, role_id=9afe1d161ebd4d80b0f0f62e206cacc9)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:51.999053 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:52.004781 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:52.006221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:52.023732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 81/164] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:36:51 2022] PUT /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3/users/88e8478c1f7f4dc58f22820e29e8c918/roles/9afe1d161ebd4d80b0f0f62e206cacc9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:36:52.024781 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:52.116443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:52.176716 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 84/165] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:52.201544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8455246-e605-48f4-8950-ad2f3d677914 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:52.231253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:52.235690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:52.244990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:52.245961 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:52.246611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:52.247065 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:52.248150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=36e70edefbb144ebbbd97da5f321c823) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:52.248622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:52.250390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:52.260969 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 82/166] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:52 2022] GET /identity/v3/role_assignments?user.id=36e70edefbb144ebbbd97da5f321c823&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:52.386926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eacd99-e122-4aff-9183-f868a872510c None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:52.428269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:52.429000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:52.429279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:52.431897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:52.452167 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:52.460308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:52.461364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:52.462291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 85/167] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:52.469345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:52.603147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054fc90-ef9b-4529-b077-f880dd619dd8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:52.641288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:52.642928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:52.643435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:52.643923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:52.644924 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:52.645472 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:52.647104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:52.656612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 83/168] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:52.663925 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:52.727971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:52.813842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d549429-192c-4b26-875e-f9e0c98fdaef None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:52.854405 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f3eb0-eb24-4a07-9be8-d40275107067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:52.855318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f3eb0-eb24-4a07-9be8-d40275107067 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:52.855599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f3eb0-eb24-4a07-9be8-d40275107067 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:52.855873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f3eb0-eb24-4a07-9be8-d40275107067 None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:52.857353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f3eb0-eb24-4a07-9be8-d40275107067 None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:52.858866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f3eb0-eb24-4a07-9be8-d40275107067 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:52.860542 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 86/169] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:52 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:52.866349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:52.875077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620b36d-99db-4bd2-b494-c06389f3afed None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:52.875077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620b36d-99db-4bd2-b494-c06389f3afed None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:52.875350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620b36d-99db-4bd2-b494-c06389f3afed None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:52.876791 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 87/170] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:52.886813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:52.886813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:52.886813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:52.903034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:52.904251 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:52.938815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:52.985320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 88/171] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:53.022272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:53.037409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a753e1-b26b-4a6a-b039-6f81e39b7b95 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:53.076005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:53.100156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:53.100826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:53.101116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:53.101393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:53.182920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559fe5a-0c16-46f5-aad8-c619c1d9120c None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:53.231876 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:53.233634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:53.276915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:53.278258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:53.278771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:53.279294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:53.305735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:53.315087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:53.316118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:53.316991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:53.324723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 89/172] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:36:53.330977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:53.335301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:53.481526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 84/173] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:53.488405 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:53.540143 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:53.568345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abace65b-ed46-411f-99c4-dfca2fbe83b6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:53.660173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:53.662170 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:53.662170 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:53.662170 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:53.662456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:53.662537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:53.664022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:53.682015 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 90/174] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:53.691260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:53.697723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668db95-9c8f-4c0f-aeaf-c881f9ddc347 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:53.763943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:53.765339 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:53.765934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:53.766426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] PATH_INFO: `/v3/projects/bf9e41c35eee440ca600a8e13c64bd61` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:53.771848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=bf9e41c35eee440ca600a8e13c64bd61)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:53.773678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:53.776077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 85/175] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:53 2022] GET /identity/v3/projects/bf9e41c35eee440ca600a8e13c64bd61 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:53.800816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:53.806636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:53.857942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9137fc-19cf-4231-919e-99c42f9c3379 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:53.897913 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:53.898814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:53.899106 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:53.899382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] PATH_INFO: `/v3/users/d07be9e7872649819e166ac1192258ae` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:53.903516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] RBAC: Authorizing `identity:get_user(user_id=d07be9e7872649819e166ac1192258ae)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:53.905021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:53.907109 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 91/176] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:53 2022] GET /identity/v3/users/d07be9e7872649819e166ac1192258ae => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:53.912998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:53.955233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:54.061242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2b7f-9ebc-465a-bfc0-7863eddac1d5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:54.102883 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555eb09-747b-4300-be6d-c1b657777b32 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:54.148467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:54.149537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.150038 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.150537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.151631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=bf9e41c35eee440ca600a8e13c64bd61, user.id=d07be9e7872649819e166ac1192258ae) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:54.152179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:54.153875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:54.166848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4f69-5977-41b6-a5c6-aa75dae9916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:54.167655 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4f69-5977-41b6-a5c6-aa75dae9916c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.167940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4f69-5977-41b6-a5c6-aa75dae9916c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.168215 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4f69-5977-41b6-a5c6-aa75dae9916c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.170101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 86/177] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:53 2022] GET /identity/v3/role_assignments?user.id=d07be9e7872649819e166ac1192258ae&scope.project.id=bf9e41c35eee440ca600a8e13c64bd61&role.id=2816caba47884002a96dab7b07f4bac4 => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:54.283783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4f69-5977-41b6-a5c6-aa75dae9916c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:54.286201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4f69-5977-41b6-a5c6-aa75dae9916c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:54.324043 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:54.409559 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 92/178] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:54.419987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:54.485539 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f5a8-7fe3-4f4d-9b2f-9537a6a7fb52 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.485902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f5a8-7fe3-4f4d-9b2f-9537a6a7fb52 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.486149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f5a8-7fe3-4f4d-9b2f-9537a6a7fb52 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.487991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 93/179] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:54.493946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.494232 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.494511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.513123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:54.514481 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:54.522783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:54.580983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779b55b-f3a4-4d04-94cf-0f26bdac6ab7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:54.603378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 94/180] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:54.641421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:54.654634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:54.655930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.656377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.656792 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.659577 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:54.661433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:54.663475 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 87/181] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:54 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:54.669414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:54.747153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:54.822207 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d937d-c427-4820-9ed3-5ba5e338c1a8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:54.860739 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:54.862250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.862715 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.863180 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.864226 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] RBAC: Adding query filter params (role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=d07be9e7872649819e166ac1192258ae) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:54.864704 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:54.866383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b658be-928c-4a66-b910-b5a1166ae4f2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:54.870101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:54.874924 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 88/182] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:54 2022] GET /identity/v3/role_assignments?user.id=d07be9e7872649819e166ac1192258ae&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:54.885335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43faafe-d080-4128-8efe-0ec650daa5b4 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:54.926910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7d784-e516-42b2-83dc-86b6007895fe None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.927473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7d784-e516-42b2-83dc-86b6007895fe None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.927934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7d784-e516-42b2-83dc-86b6007895fe None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.929568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 89/183] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:36:54.936996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.937533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.938147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.959842 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:54.961617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:54.967674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:54.968512 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:54.968800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:54.969079 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:54.999932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:55.009643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:55.011017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:55.011994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 95/184] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:55.019842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.065140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 90/185] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:55.111946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.176414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9637c-92ba-44d6-a25e-a0fa7250f919 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.195576 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:55.222048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.222727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.223162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.223452 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.224332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:55.224643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:55.226078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f93a-05a1-4033-96c5-c6774fa044f1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:55.238814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 96/186] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:55.238814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f49a06-3b90-4693-a19c-ed59878929f0 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.238814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f49a06-3b90-4693-a19c-ed59878929f0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.238814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f49a06-3b90-4693-a19c-ed59878929f0 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.240157 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 97/187] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:55.243391 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f49a06-3b90-4693-a19c-ed59878929f0 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.270638 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30056ba8-a8fb-4479-a23a-94dd0aa72813 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.302585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:55.309514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9e433-bb72-418b-8def-79ed7cecbe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.310332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9e433-bb72-418b-8def-79ed7cecbe91 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.310609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9e433-bb72-418b-8def-79ed7cecbe91 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.310932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9e433-bb72-418b-8def-79ed7cecbe91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.312195 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9e433-bb72-418b-8def-79ed7cecbe91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:55.313686 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9e433-bb72-418b-8def-79ed7cecbe91 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:55.320506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 91/188] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:55.320506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.320506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.320506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.337579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:55.338782 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:55.367475 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f49a06-3b90-4693-a19c-ed59878929f0 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.406759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.408195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.408736 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.408736 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] PATH_INFO: `/v3/users/3eca64f9618d496caab37f71000ddf28` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.413318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 92/189] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:55.413972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.431583 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] RBAC: Authorizing `identity:get_user(user_id=3eca64f9618d496caab37f71000ddf28)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:55.433289 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:55.435693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 98/190] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/users/3eca64f9618d496caab37f71000ddf28 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:55.436658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.475263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:55.530695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c77d9a-b245-409f-af71-8ef95c49b120 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.544192 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594cbaf-2bd5-40ba-9628-9149c49c6c01 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.557305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:55.565900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.566592 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.566906 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.567185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.567903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:55.569369 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:55.578706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47963116-2f1e-4c06-b904-544511407c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.579593 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47963116-2f1e-4c06-b904-544511407c63 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.579885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47963116-2f1e-4c06-b904-544511407c63 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.580164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47963116-2f1e-4c06-b904-544511407c63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.597772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 93/191] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:36:55 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:55.597772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.598140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47963116-2f1e-4c06-b904-544511407c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-47963116-2f1e-4c06-b904-544511407c63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:55.599669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:55.600733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 99/192] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:36:55.607823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2730a-4f55-4939-8efa-c2de5b7429a3 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.608642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2730a-4f55-4939-8efa-c2de5b7429a3 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.608642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2730a-4f55-4939-8efa-c2de5b7429a3 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.608642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 100/193] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:55.608642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2730a-4f55-4939-8efa-c2de5b7429a3 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.724610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d1456-11e2-4131-b8d0-106405120d0c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.736114 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:55.745159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2730a-4f55-4939-8efa-c2de5b7429a3 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:55.768501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.769260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.770133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.770420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.782336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:55.783662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.783949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.784225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.785033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:55.785297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:55.786731 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c7569-1a46-4b05-85bc-7758b960d40d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:55.796849 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 101/194] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:55.798838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:55.798838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:55.798838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:55.817784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:55.819036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:55.838479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:55.858725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:55.859337 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:55.900774 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 102/195] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:55.901665 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:55.985504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 94/196] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:55.986407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.024443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.040737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a055a-710c-40e9-8622-bbf372952cab None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.078261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.079296 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.080234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.080565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] PATH_INFO: `/v3/users/3eca64f9618d496caab37f71000ddf28` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.081837 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=3eca64f9618d496caab37f71000ddf28)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.082742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.084174 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.086165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 103/197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/users/3eca64f9618d496caab37f71000ddf28 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:56.087065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.100195 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6408b-3df0-4548-8e47-493882befd2b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.138184 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.139131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.139441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.139792 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.151607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:56.160030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:56.161052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:36:56.162009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 95/198] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:56.162780 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.197102 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa50668-7b52-4b74-b9be-8c8d1e468fe6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.233322 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.234186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.234468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.234740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.236116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.238328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.240325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 104/199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:56.240926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.274666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.279411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17314f-1367-4ffc-b743-b974d2a70eea None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.319940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.320991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.321434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.321865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.339151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.354826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511e282-784b-4c12-8e17-9a7f65c6581f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.391269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.391932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.392828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.393063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.393822 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:56.394126 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.395536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.399571 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.401345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.405040 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 105/200] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:56.410045 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.509963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.521423 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 96/201] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:56.522957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.530733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2078727-1d75-42f1-b3ef-44cfc4cdc821 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.569363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.569890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.570177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.570505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.571397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=3eca64f9618d496caab37f71000ddf28) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:56.571711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.573185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.575364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.579226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 106/202] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/role_assignments?user.id=3eca64f9618d496caab37f71000ddf28&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:56.580581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.642515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271c4c-0045-46eb-b954-19d34154eea3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.698493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.699931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.700432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.700921 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] PATH_INFO: `/v3/users/88e8478c1f7f4dc58f22820e29e8c918` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.702488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] RBAC: Authorizing `identity:get_user(user_id=88e8478c1f7f4dc58f22820e29e8c918)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.704254 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.706762 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 97/203] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/users/88e8478c1f7f4dc58f22820e29e8c918 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:56.712480 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.825593 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310353-28ab-49ca-a0e3-6fa6bb281033 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.847254 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:56.857585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6acf-49b2-4cf2-aea1-9be89e4eaa11 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:56.885620 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.886651 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.887171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.888621 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.929870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:56.931971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:56.933949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:56.934919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:56.937831 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:56.942273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:56.946547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 107/204] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:56.952006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:56.986325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:57.044617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:57.047960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:57.129018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59b22-7aee-4c42-bf5c-19e0e84fed00 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:57.196284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:57.197364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:57.197844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:57.198312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:57.199542 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] RBAC: Adding query filter params (role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=3eca64f9618d496caab37f71000ddf28) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:57.200049 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:57.201994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:57.209154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 108/205] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/role_assignments?user.id=3eca64f9618d496caab37f71000ddf28&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:57.281200 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 98/206] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:57.287051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:57.425044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:57.453976 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf67d-c03b-47a8-a8ca-4517c894378e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:57.505060 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c2e00-8492-4aa2-8710-550050d13496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:57.505946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c2e00-8492-4aa2-8710-550050d13496 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:57.506233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c2e00-8492-4aa2-8710-550050d13496 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:57.506509 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c2e00-8492-4aa2-8710-550050d13496 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:57.507769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c2e00-8492-4aa2-8710-550050d13496 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:57.509323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c2e00-8492-4aa2-8710-550050d13496 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:57.511283 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 109/207] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:57 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:57.517078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:57.531770 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:57.628417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd7890-3933-4493-baaa-7b042c42f73d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:57.668478 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:57.669206 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:57.669494 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:57.669776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:57.670621 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] RBAC: Adding query filter params (role.id=9afe1d161ebd4d80b0f0f62e206cacc9, scope.project.id=1c9f3c82497249eabf902ceb21d001b3, user.id=88e8478c1f7f4dc58f22820e29e8c918) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:57.670996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:57.672530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd00c9-6c8d-4829-8b80-a26876667b05 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:57.679680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 99/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:57 2022] GET /identity/v3/role_assignments?user.id=88e8478c1f7f4dc58f22820e29e8c918&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=9afe1d161ebd4d80b0f0f62e206cacc9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:58.168245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cd9ca-e178-4b94-acb8-19ccbf8a16f7 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.168792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cd9ca-e178-4b94-acb8-19ccbf8a16f7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.168792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cd9ca-e178-4b94-acb8-19ccbf8a16f7 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.170203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 110/209] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:58.175841 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099836-7949-4025-8b00-a5988aa2a049 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.176319 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099836-7949-4025-8b00-a5988aa2a049 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.176607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099836-7949-4025-8b00-a5988aa2a049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.196248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-c0099836-7949-4025-8b00-a5988aa2a049 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:58.197466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-c0099836-7949-4025-8b00-a5988aa2a049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:58.283523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 100/210] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:58.293783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c7472-0a97-4782-ba07-7b276aeb1a16 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.293783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c7472-0a97-4782-ba07-7b276aeb1a16 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.293783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c7472-0a97-4782-ba07-7b276aeb1a16 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.294545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 111/211] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:58.300027 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.300321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.300605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.306411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c7472-0a97-4782-ba07-7b276aeb1a16 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:58.312142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:58.319501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:58.321008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:58.398860 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 101/212] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:36:58.423315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:58.438685 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c7472-0a97-4782-ba07-7b276aeb1a16 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:58.478477 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:58.479364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.479650 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.479976 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.493135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:58.502622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:58.503656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:36:58.505401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:58.509398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 112/213] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:36:58.510574 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:58.524047 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:58.536916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea3bf-bbf8-427f-bd26-76fb8c624ff0 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:58.572694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:58.573496 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.573783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.574060 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.575299 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:58.576767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:58.579069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 102/214] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:58.585469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:58.591968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:58.635945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96e20-e2a3-4f9b-857f-c3d4e297fba5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:58.684954 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:58.686127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.686537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.686923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.687765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:58.688150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:58.690768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:58.703032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f01ca-7ef5-4578-85d3-aef905e10ad0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:58.703325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 113/215] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:36:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:58.708316 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:58.754585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:58.755618 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.756099 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.756566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.757539 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:58.759337 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:58.791039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 103/216] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:36:58 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:36:58.812115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:58.836275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a5ff-da51-4452-a04b-19a937d424d2 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:58.886991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6b208-17ab-4628-ba93-452309f217bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:58.887901 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6b208-17ab-4628-ba93-452309f217bd None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:58.888186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6b208-17ab-4628-ba93-452309f217bd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:58.888463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6b208-17ab-4628-ba93-452309f217bd None admin] PATH_INFO: `/v3/users/393dc65fbc3542c6ae59077558c2f5d1` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:58.904958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6b208-17ab-4628-ba93-452309f217bd None admin] RBAC: Authorizing `identity:get_user(user_id=393dc65fbc3542c6ae59077558c2f5d1)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:58.906479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6b208-17ab-4628-ba93-452309f217bd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:58.908714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 114/217] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:58 2022] GET /identity/v3/users/393dc65fbc3542c6ae59077558c2f5d1 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:36:58.916037 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:58.986382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:59.034779 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04130fcc-a77e-4d1c-b1e3-b0bf03d91bc3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:59.070327 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:59.071005 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.071289 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.071572 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.147169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:59.148622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:59.184025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c3c3-6ff9-400c-8eb5-52320228c47c None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.184544 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c3c3-6ff9-400c-8eb5-52320228c47c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.184646 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c3c3-6ff9-400c-8eb5-52320228c47c None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.185977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 115/218] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:59.191301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.191587 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.191865 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.212884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:59.214087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:36:59.225897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:59.284487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 104/219] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:36:59.290355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:59.314661 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 116/220] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:36:59.341273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:59.395324 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb077cb-5914-4fb9-817f-2625a463e35a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:59.431425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:59.432457 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.432605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.432879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.434155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:59.435653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:59.437573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 105/221] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:36:59 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:59.446975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:59.451575 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:59.506510 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:59.549101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d61de-94f9-4c1b-9ee2-0d8726681fa1 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:59.586017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390270c-a62e-4b2b-aef7-427e1f7df175 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:59.623599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:59.624319 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.624541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.624820 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.625661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=393dc65fbc3542c6ae59077558c2f5d1) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:59.625974 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:59.627501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:59.638932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 106/222] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:36:59 2022] GET /identity/v3/role_assignments?user.id=393dc65fbc3542c6ae59077558c2f5d1&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=2816caba47884002a96dab7b07f4bac4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:59.664741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:59.665581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.665930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.666220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.691953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:36:59.703994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:36:59.705656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:36:59.706537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 117/223] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:36:59.713747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:59.849906 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:36:59.862138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8e9-0a8e-4c7b-9cb3-9dfd6f75a539 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:36:59.909014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:36:59.909687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.909969 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.910246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.911024 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:36:59.911397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:36:59.912836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3c68f-7937-4cff-933d-44db20378b9d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:36:59.921966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 107/224] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:36:59.927790 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:36:59.958594 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115815-186a-4bfc-a604-4ff8ea5740fb None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.958962 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115815-186a-4bfc-a604-4ff8ea5740fb None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.959183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115815-186a-4bfc-a604-4ff8ea5740fb None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.960705 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 108/225] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:36:59.966119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:36:59.966411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:36:59.966690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:36:59.994862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:36:59.996081 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:00.066710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21303c15-b4b3-4d57-be37-5abfed5409ca None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:00.101565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:00.123857 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 109/226] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:00.129953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:00.130922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:00.131212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:00.131538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] PATH_INFO: `/v3/users/3eca64f9618d496caab37f71000ddf28` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:00.132803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] RBAC: Authorizing `identity:get_user(user_id=3eca64f9618d496caab37f71000ddf28)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:00.134291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:00.136065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 118/227] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:36:59 2022] GET /identity/v3/users/3eca64f9618d496caab37f71000ddf28 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:00.143881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:00.166548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:00.278833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:00.284308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b633ea-5c94-434d-bfdd-cd51aadfca7a None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:00.354450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:00.355253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:00.355607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:00.355890 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:00.358046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:00.359533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:00.361803 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 110/228] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:00 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:00.368221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b89108-8ea5-432a-8af2-e903e4ef6e4d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:00.370473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:00.446032 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:00.447158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:00.448896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:00.449180 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:00.469576 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:00.479953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:00.481005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:00.481887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 119/229] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:00.490233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:00.550166 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:00.565275 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ff60a-5c44-4be0-85da-3f90ae78ce74 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:00.605839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615f0a9-c62f-44cc-8b92-e09baf298582 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:00.636829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:00.637843 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:00.638134 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:00.638413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/3eca64f9618d496caab37f71000ddf28/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:00.644589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=935d2d3fa1384ca8917811ee8310cc09, user_id=3eca64f9618d496caab37f71000ddf28, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:00.646817 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:00.651139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:00.652084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:00.652582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:00.653077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:00.654039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:00.654557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:00.656428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:00.668024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 120/230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:00.674700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:00.681674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 111/231] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:00 2022] PUT /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/3eca64f9618d496caab37f71000ddf28/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:00.792888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b02c8d-74ed-48b9-bfc7-cf3cc90ca7ee None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:00.806223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:00.844577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:00.846033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:00.846315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:00.846590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] PATH_INFO: `/v3/users/3eca64f9618d496caab37f71000ddf28` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:00.847949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] RBAC: Authorizing `identity:get_user(user_id=3eca64f9618d496caab37f71000ddf28)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:00.849444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:00.851174 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 121/232] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:00 2022] GET /identity/v3/users/3eca64f9618d496caab37f71000ddf28 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:00.856964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:00.880409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:00.981823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b9fc-80e8-4689-b396-ce33f82132f6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:01.022945 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e743e7f-2e0c-486d-b675-d38753023d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:01.023814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e743e7f-2e0c-486d-b675-d38753023d7f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:01.024104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e743e7f-2e0c-486d-b675-d38753023d7f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:01.024374 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e743e7f-2e0c-486d-b675-d38753023d7f None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:01.025571 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e743e7f-2e0c-486d-b675-d38753023d7f None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:01.027056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e743e7f-2e0c-486d-b675-d38753023d7f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:01.034946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 112/233] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:00 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:01.040821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:01.178753 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292aa0f-52c9-4b0a-aa0f-64722274a59c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:01.214204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3af7c-ab8a-49af-99ab-bfd7dc21d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:01.215165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3af7c-ab8a-49af-99ab-bfd7dc21d333 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:01.215449 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3af7c-ab8a-49af-99ab-bfd7dc21d333 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:01.215721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3af7c-ab8a-49af-99ab-bfd7dc21d333 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/3eca64f9618d496caab37f71000ddf28/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:01.218144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3af7c-ab8a-49af-99ab-bfd7dc21d333 None admin] RBAC: Authorizing `identity:create_grant(project_id=935d2d3fa1384ca8917811ee8310cc09, user_id=3eca64f9618d496caab37f71000ddf28, role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:01.219683 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3af7c-ab8a-49af-99ab-bfd7dc21d333 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:01.236327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 122/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:01 2022] PUT /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/3eca64f9618d496caab37f71000ddf28/roles/0cebdd5895894be58dd945aadfab5e3f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:01.652524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa743-5b42-4005-8f99-7e9c2daeb79b None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:01.653092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa743-5b42-4005-8f99-7e9c2daeb79b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:01.653092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa743-5b42-4005-8f99-7e9c2daeb79b None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:01.654669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 113/235] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:01.660333 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:01.660765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:01.660948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:01.678340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:01.679579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:01.711381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:01.758268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 123/236] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:01.781335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fa743-5b42-4005-8f99-7e9c2daeb79b None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:01.867949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:01.894627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fa743-5b42-4005-8f99-7e9c2daeb79b None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:01.945418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9392a-3f86-428d-933c-836210695d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:01.946255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9392a-3f86-428d-933c-836210695d18 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:01.946537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9392a-3f86-428d-933c-836210695d18 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:01.946826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9392a-3f86-428d-933c-836210695d18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:01.960193 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9392a-3f86-428d-933c-836210695d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-42c9392a-3f86-428d-933c-836210695d18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:01.967956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:01.968960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:01.970309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 114/237] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:01.975245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:02.079658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c695c1-4e87-4308-a011-1accaaa5325d None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:02.085781 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63c18d-cec6-437a-9cf9-714378591120 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.086316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63c18d-cec6-437a-9cf9-714378591120 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.086856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63c18d-cec6-437a-9cf9-714378591120 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.089865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 115/238] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:02.094296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.094864 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.095986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.125280 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:02.126498 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:02.131383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:02.132055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.132333 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.132606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.133360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:02.133650 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:02.135069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:02.151285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 124/239] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:02.157423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:02.224273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:02.236545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 116/240] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:02.283978 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:02.344875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e237-2deb-4803-a6a1-43c74a5bd9c6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:02.381510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:02.382387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.382672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.382974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] PATH_INFO: `/v3/users/f1e69d22e61d4942854efcc31301481b` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.397847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] RBAC: Authorizing `identity:get_user(user_id=f1e69d22e61d4942854efcc31301481b)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:02.399365 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:02.401406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 125/241] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:02 2022] GET /identity/v3/users/f1e69d22e61d4942854efcc31301481b => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:02.406706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:02.442272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:02.518995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:02.528784 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc4a7-1775-4195-8b89-8b5772f74853 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:02.536153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b73898-e53c-4ace-8712-aefff3f6f11e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:02.596209 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:02.597020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.597310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.597593 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.599905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:02.601381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:02.603321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 117/242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:02.609246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:02.615444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:02.616120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.616410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.616692 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.709638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:02.711193 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:02.747155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b475d34-a9bd-4c24-86d9-d87f28d73891 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:02.785230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3da4b-8544-4f62-b836-ffed9b52c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:02.785615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3da4b-8544-4f62-b836-ffed9b52c9e3 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.785905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3da4b-8544-4f62-b836-ffed9b52c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.786183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3da4b-8544-4f62-b836-ffed9b52c9e3 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.786979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3da4b-8544-4f62-b836-ffed9b52c9e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:02.788438 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3da4b-8544-4f62-b836-ffed9b52c9e3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:02.797916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:02.815347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 118/243] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:02 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:37:02.819854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fae75-ec6f-4a45-a9e9-ca29763f3ea2 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.819854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fae75-ec6f-4a45-a9e9-ca29763f3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.819854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fae75-ec6f-4a45-a9e9-ca29763f3ea2 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.819854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 119/244] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:02.825795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:02.826085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:02.826374 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:02.842317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:02.849947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:02.851382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:02.879413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 126/245] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:37:02.884296 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.040726 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 120/246] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:03.049957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8dc9-0340-4f29-8e3d-6b0b0c25bc78 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.080037 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.100761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.103010 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.103294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.103566 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.105560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:03.107070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:03.109504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 127/247] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:02 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:03.116007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.200871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:03.231619 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebf369-f700-45f0-89dd-7b1939431b20 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.264039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ab91-1718-47e9-98e9-8aa90d759e41 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.264462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:03.287071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.288357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.288858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.289362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.308245 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:03.319017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:03.321897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:03.323013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 121/248] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:03.333126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.355307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.356084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.356444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.356838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.357961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] RBAC: Adding query filter params (role.id=9afe1d161ebd4d80b0f0f62e206cacc9, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=f1e69d22e61d4942854efcc31301481b) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:03.358385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:03.361512 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:03.371419 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 128/249] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/role_assignments?user.id=f1e69d22e61d4942854efcc31301481b&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=9afe1d161ebd4d80b0f0f62e206cacc9 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:03.466305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880280-4444-4d58-b3d6-4ea597d0e57e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.508057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.508755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.509040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.509320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.510113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:03.510426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:03.511896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9ca14-fd18-46d1-97f2-a9c2ee94db6a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:03.522467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 122/250] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:03.529473 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.622572 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c409-bb3d-4a8c-99ce-4d0a9a75cf09 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.622902 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c409-bb3d-4a8c-99ce-4d0a9a75cf09 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.623200 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c409-bb3d-4a8c-99ce-4d0a9a75cf09 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.624603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 123/251] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:03.630288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.630597 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.630899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.652271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:03.653531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:03.693165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e214ca-d743-4f7d-ab3b-785a5f7da42b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.705472 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:03.731197 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:03.742914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 124/252] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:03.752486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.753394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.753679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.753959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] PATH_INFO: `/v3/users/393dc65fbc3542c6ae59077558c2f5d1` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.755396 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] RBAC: Authorizing `identity:get_user(user_id=393dc65fbc3542c6ae59077558c2f5d1)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:03.757150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:03.759009 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 129/253] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/users/393dc65fbc3542c6ae59077558c2f5d1 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:03.764481 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.770058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.896944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717aa99-23f4-4584-a661-8dd58613254d None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.933584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a7852-f6c5-4e60-b25f-5b1053a4873c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:03.935690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd04cf-8d4e-42c2-9095-006febfbe6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.937849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd04cf-8d4e-42c2-9095-006febfbe6dd None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.937849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd04cf-8d4e-42c2-9095-006febfbe6dd None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.937849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd04cf-8d4e-42c2-9095-006febfbe6dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.953955 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd04cf-8d4e-42c2-9095-006febfbe6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-6ddd04cf-8d4e-42c2-9095-006febfbe6dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:03.969155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:03.970994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:03.972108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:03.974622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 125/254] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:03.981813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf46ce-af68-428e-838f-33e359294aa1 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.982652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf46ce-af68-428e-838f-33e359294aa1 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.983134 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf46ce-af68-428e-838f-33e359294aa1 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.984880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 126/255] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:03.985756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf46ce-af68-428e-838f-33e359294aa1 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:03.998848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813d7e-956f-4cb9-b14e-cb521f32857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:03.998848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813d7e-956f-4cb9-b14e-cb521f32857b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:03.998848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813d7e-956f-4cb9-b14e-cb521f32857b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:03.998848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813d7e-956f-4cb9-b14e-cb521f32857b None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:03.999299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813d7e-956f-4cb9-b14e-cb521f32857b None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:04.000031 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813d7e-956f-4cb9-b14e-cb521f32857b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:04.011749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 130/256] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:04.011749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.011749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.011749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.029666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:04.031473 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:04.098899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:04.099177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:04.122773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 131/257] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:04.123635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:04.236991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf46ce-af68-428e-838f-33e359294aa1 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:04.280987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931570f-7ff4-4701-9a9d-4c130e3d93c5 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:04.303481 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:04.304162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.304451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.304733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.305501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:04.305814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:04.307270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:04.327119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 127/258] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:04.327988 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:04.348275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:04.349181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.349463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.349740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/393dc65fbc3542c6ae59077558c2f5d1/roles/2816caba47884002a96dab7b07f4bac4` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.351796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=935d2d3fa1384ca8917811ee8310cc09, user_id=393dc65fbc3542c6ae59077558c2f5d1, role_id=2816caba47884002a96dab7b07f4bac4)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:04.353279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:04.388971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 132/259] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:04 2022] PUT /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/393dc65fbc3542c6ae59077558c2f5d1/roles/2816caba47884002a96dab7b07f4bac4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:04.390257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:04.444555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:04.500985 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:04.506109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da01d5-7e74-4d37-ad26-76dca32418f2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:04.521563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5da743-6e4d-4d59-b27b-679634d3f3d6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:04.584611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:04.586746 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.587297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.588879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.601787 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:04.603085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.603580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.604064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] PATH_INFO: `/v3/users/3eca64f9618d496caab37f71000ddf28` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.606427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] RBAC: Authorizing `identity:get_user(user_id=3eca64f9618d496caab37f71000ddf28)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:04.608655 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:04.613572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 133/260] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:04 2022] GET /identity/v3/users/3eca64f9618d496caab37f71000ddf28 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:04.614854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:04.619185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:04.631662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:04.632819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:04.633718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:04.637126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 128/261] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:04.644303 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:04.781095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eac39b-c70f-455b-bf4e-2d5e1618b5fc None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:04.788245 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02228-ea06-4ac8-a6b3-3a51b039976a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:04.795792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:04.829961 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:04.831046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.831544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.832049 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.833077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:04.833610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:04.835263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:04.835467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:04.836116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:04.836395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:04.836672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:04.845719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 129/262] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:04.851671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:04.877840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:04.939136 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:04.940920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:05.047537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50e80-45b5-42f0-952c-90b08e1e440f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:05.103180 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 134/263] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:05.112105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:05.133129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:05.134451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:05.135701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:05.138122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] PATH_INFO: `/v3/users/3eca64f9618d496caab37f71000ddf28` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:05.139756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] RBAC: Authorizing `identity:get_user(user_id=3eca64f9618d496caab37f71000ddf28)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:05.141444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:05.146726 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 130/264] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:04 2022] GET /identity/v3/users/3eca64f9618d496caab37f71000ddf28 => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:05.157954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:05.158516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:05.355838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7b358-5501-4b61-96c7-226b73745a34 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:05.372972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:05.394293 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8681da-c8c8-4521-8795-37ed591b44f5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:05.425315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:05.426187 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:05.426466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:05.426740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:05.428603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:05.430073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:05.433070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 135/265] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:05 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:05.440354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:05.463174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:05.463831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:05.464166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:05.464447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:05.594533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:05.604096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:05.605590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:05.643246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94418539-ec16-44ec-848a-8aefd1443557 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:05.701973 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:05.702693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:05.703011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:05.703291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:05.704135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=3eca64f9618d496caab37f71000ddf28) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:05.704566 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:05.706103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:05.721454 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 136/266] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:05 2022] GET /identity/v3/role_assignments?user.id=3eca64f9618d496caab37f71000ddf28&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:05.805589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:05.825797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 131/267] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:05.831328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:05.975604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863250f-5f4c-47f8-aab4-dd5de0c23e14 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:06.024188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ef0e5-c03a-4ba0-b2c0-0f9a777b8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:06.025082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ef0e5-c03a-4ba0-b2c0-0f9a777b8a81 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.025372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ef0e5-c03a-4ba0-b2c0-0f9a777b8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.025801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ef0e5-c03a-4ba0-b2c0-0f9a777b8a81 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.027109 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ef0e5-c03a-4ba0-b2c0-0f9a777b8a81 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:06.028619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ef0e5-c03a-4ba0-b2c0-0f9a777b8a81 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:06.030592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 137/268] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:05 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:06.036874 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:06.172449 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528b783-be77-4f21-b996-adf06234cfff None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:06.220976 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:06.221646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.221936 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.222218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.223100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] RBAC: Adding query filter params (role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=3eca64f9618d496caab37f71000ddf28) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:06.223416 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:06.225402 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9266-416a-49ba-b658-6a6cab6b0a95 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:06.237031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 132/269] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:06 2022] GET /identity/v3/role_assignments?user.id=3eca64f9618d496caab37f71000ddf28&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:06.421238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4f8b6-c1c9-4f95-8d9c-2819633881e5 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.421983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4f8b6-c1c9-4f95-8d9c-2819633881e5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.422492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4f8b6-c1c9-4f95-8d9c-2819633881e5 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.424682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 138/270] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:06.430320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071959f-822b-4fc5-b5ff-1d17987eefe7 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.431005 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071959f-822b-4fc5-b5ff-1d17987eefe7 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.431540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071959f-822b-4fc5-b5ff-1d17987eefe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.454046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-9071959f-822b-4fc5-b5ff-1d17987eefe7 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:06.456217 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-9071959f-822b-4fc5-b5ff-1d17987eefe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:06.523742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:06.552603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 133/271] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:06.587366 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4f8b6-c1c9-4f95-8d9c-2819633881e5 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:06.605598 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:06.639607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa212-34f9-4987-9d81-e9fa0c57c7b5 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.639962 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa212-34f9-4987-9d81-e9fa0c57c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.640174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa212-34f9-4987-9d81-e9fa0c57c7b5 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.641766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 134/272] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:06.647929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f24c90-d112-4559-9585-927538726a90 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.648518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f24c90-d112-4559-9585-927538726a90 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.649022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f24c90-d112-4559-9585-927538726a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.671912 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-a9f24c90-d112-4559-9585-927538726a90 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:06.673299 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-a9f24c90-d112-4559-9585-927538726a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:06.723747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4f8b6-c1c9-4f95-8d9c-2819633881e5 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:06.762474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 135/273] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:06.764114 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4ba3-66d7-4f4d-9927-6cddd1c7bdc7 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.764445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4ba3-66d7-4f4d-9927-6cddd1c7bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.764726 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4ba3-66d7-4f4d-9927-6cddd1c7bdc7 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.766086 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 136/274] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:06.772219 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.772841 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.773459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.773712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:06.774749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.775211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.775634 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.788670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:06.795068 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:06.796476 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:06.797073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:06.798017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:06.798943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:06.801500 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 139/275] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:06.802470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:06.872483 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 137/276] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:06.874020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:06.893370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:06.927534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f093d8-81a5-4cdb-ae4d-a7e654a66c8f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:06.929400 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:06.966162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:06.966997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:06.967285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:06.967561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:06.982129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:06.988137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ea0a1-023b-4d18-afb5-4b47f41f37ed None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:06.990839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:06.992014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 140/277] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:06.993247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.032048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.032672 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.032959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.033235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.033996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:07.034303 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.035759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.045261 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 138/278] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.046067 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.107431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a6c8-62e4-4f0a-bfc7-6a4ab6913457 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.140624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:07.146577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.147410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.147699 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.147979 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.149170 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.150662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.156996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 141/279] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.156996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.166821 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1bf33-27c1-421c-b7b0-55f5611da1be None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.170295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:07.207563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.208232 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.208521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.208797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.209556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:07.209866 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.211297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.220073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 139/280] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.220662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.274006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc92923-c0d1-4120-bf95-47d2c1e8f11a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.316212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.317384 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.317668 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.317943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] PATH_INFO: `/v3/users/c8baa7c5c4b0436b93cc799c13dcdc40` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.332785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd4620-5f22-46e0-b7c4-38bc6b5a4a97 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.336134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] RBAC: Authorizing `identity:get_user(user_id=c8baa7c5c4b0436b93cc799c13dcdc40)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.337799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.339717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 142/281] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:07 2022] GET /identity/v3/users/c8baa7c5c4b0436b93cc799c13dcdc40 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.340836 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.375339 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.376011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.376353 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.376642 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.377372 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.378842 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.406833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 140/282] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:07 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:07.406833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.411520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:07.447836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:07.472621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7ec10-0a84-4d85-9216-5bbb1a1c704c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.523070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc48d0-9cec-40ea-aaa6-57efc9d50e1c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.523426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.524346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.524829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.525112 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] PATH_INFO: `/v3/users/f1e69d22e61d4942854efcc31301481b` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.527353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e69d22e61d4942854efcc31301481b)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.528853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.534987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 143/283] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:07 2022] GET /identity/v3/users/f1e69d22e61d4942854efcc31301481b => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.538390 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.568988 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.569578 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.569866 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.570147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.571179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, user.id=c8baa7c5c4b0436b93cc799c13dcdc40, scope.system=all) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:07.571498 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.572998 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac966c-2c59-4f16-88c3-f85f1bcfddde None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.579757 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 141/284] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:37:07 2022] GET /identity/v3/role_assignments?user.id=c8baa7c5c4b0436b93cc799c13dcdc40&scope.system=all&role.id=2816caba47884002a96dab7b07f4bac4 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.681729 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8ba9-12de-42a6-bcfe-134e426b9c87 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.682023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8ba9-12de-42a6-bcfe-134e426b9c87 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.682302 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8ba9-12de-42a6-bcfe-134e426b9c87 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.683896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0044b8-b899-4fef-85ea-5d4057a3c067 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.684016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 142/285] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:07.690197 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.690890 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.691419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.711972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:07.713579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:07.717994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:07.728909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.729770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.730050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.730320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.731747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.734215 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.735854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 144/286] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:07 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:07.742149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.804976 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 143/287] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:07.829128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:07.848883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:07.872314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89399-7770-43ea-9001-dc337b558aa3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.923050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.924958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.925468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.925956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/f1e69d22e61d4942854efcc31301481b/roles/9afe1d161ebd4d80b0f0f62e206cacc9` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:07.928357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=935d2d3fa1384ca8917811ee8310cc09, user_id=f1e69d22e61d4942854efcc31301481b, role_id=9afe1d161ebd4d80b0f0f62e206cacc9)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:07.930952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:07.950408 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 145/288] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:07 2022] PUT /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09/users/f1e69d22e61d4942854efcc31301481b/roles/9afe1d161ebd4d80b0f0f62e206cacc9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:07.952831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1683a-6bcd-46b3-adad-700b6706b5a1 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:07.992354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:07.993173 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:07.993464 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:07.993749 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:08.006368 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:08.014392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:08.015673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:08.016735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 144/289] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:08.022616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:08.084956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:08.137512 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60c68-de1a-4f59-b561-bbab22edb0b4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:08.177162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:08.177850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:08.178139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:08.178414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:08.179239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:08.179553 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:08.181004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:08.191729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 146/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:08.197602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:08.288079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:08.308629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287909dc-91ea-43ab-b0e3-9816bef5e42a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:08.346330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:08.347163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:08.347453 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:08.347734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] PATH_INFO: `/v3/users/393dc65fbc3542c6ae59077558c2f5d1` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:08.348977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] RBAC: Authorizing `identity:get_user(user_id=393dc65fbc3542c6ae59077558c2f5d1)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:08.350452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:08.352355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 145/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:08 2022] GET /identity/v3/users/393dc65fbc3542c6ae59077558c2f5d1 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:08.358130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:08.466582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6f68-e540-420b-96ed-7e8ff3d55cdb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:08.487903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:08.504679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:08.505344 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:08.505635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:08.505916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:08.579949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:08.581433 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:08.690200 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 147/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:08.695819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:08.806127 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10858c5-77be-4ed4-9100-1d8897df3b65 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:08.854664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd926f-79ea-4930-ae4f-f652dff11456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:08.855566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd926f-79ea-4930-ae4f-f652dff11456 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:08.855948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd926f-79ea-4930-ae4f-f652dff11456 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:08.856236 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd926f-79ea-4930-ae4f-f652dff11456 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:08.857775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd926f-79ea-4930-ae4f-f652dff11456 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:08.859329 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd926f-79ea-4930-ae4f-f652dff11456 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:08.862059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 146/293] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:08 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:08.867741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:08.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:08.991152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c51d39-a84a-40da-ad6d-191635e6718e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:09.027312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:09.027976 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:09.028262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:09.028543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:09.029381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=393dc65fbc3542c6ae59077558c2f5d1) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:09.029695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:09.031196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfea22-0478-4f18-9b7c-6684b2cdfbf3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:09.038266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 148/294] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:08 2022] GET /identity/v3/role_assignments?user.id=393dc65fbc3542c6ae59077558c2f5d1&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=2816caba47884002a96dab7b07f4bac4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:10.187934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f682d5e-5854-44fb-aeb7-082d58af1ef3 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.188662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f682d5e-5854-44fb-aeb7-082d58af1ef3 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.188662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f682d5e-5854-44fb-aeb7-082d58af1ef3 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.190710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 147/295] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:10.196501 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896405f5-c56b-45f3-8218-2f8ec51590a6 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.197493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896405f5-c56b-45f3-8218-2f8ec51590a6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.197989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896405f5-c56b-45f3-8218-2f8ec51590a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.217587 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-896405f5-c56b-45f3-8218-2f8ec51590a6 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:10.219227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-896405f5-c56b-45f3-8218-2f8ec51590a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:10.293155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 149/296] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:10.304596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f33f6-26e5-4478-a24b-37c43d248667 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.305215 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f33f6-26e5-4478-a24b-37c43d248667 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.305709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f33f6-26e5-4478-a24b-37c43d248667 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.307624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 148/297] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:10.313056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772c22-b0f7-40db-b1a6-d90bb276ba49 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.313600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772c22-b0f7-40db-b1a6-d90bb276ba49 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.314121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772c22-b0f7-40db-b1a6-d90bb276ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.316365 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f33f6-26e5-4478-a24b-37c43d248667 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.331892 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-63772c22-b0f7-40db-b1a6-d90bb276ba49 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:10.333100 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-63772c22-b0f7-40db-b1a6-d90bb276ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:10.333519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:10.336211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:10.405945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 150/298] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:10.407324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d746b0a-07a9-4afb-bc43-839b3fd88a27 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.408320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d746b0a-07a9-4afb-bc43-839b3fd88a27 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.408757 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d746b0a-07a9-4afb-bc43-839b3fd88a27 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.410457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 151/299] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:10.416230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.416521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.416807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.435381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f33f6-26e5-4478-a24b-37c43d248667 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.437342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:10.439499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:10.473665 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.474468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.474741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.475044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.486497 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:10.494253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:10.495235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 149/300] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:10.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.516930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 152/301] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:10.517826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.589664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:10.598006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:10.625316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb78a8d-7b08-40da-b54e-41daf6c8a9ad None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.633418 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3a57-2ec9-40e0-a2ae-07b37613c691 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.661110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.661917 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.662204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.662483 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.674093 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:10.677750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.678419 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.678695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.678995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.679866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:10.680397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:10.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:10.682980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:10.689430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:10.690325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:10.690417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 150/302] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:10.690417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.696624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 153/303] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:10.697169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.795602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc130d9-37f5-487d-b98d-b17c763cf172 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.801567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71200ef1-cd5d-4f83-8eb3-4bbe44cafccc None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.825001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:10.830417 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:10.830699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.831530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.831868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.832198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.833594 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:10.835194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:10.835984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.836653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.836942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.841912 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 151/304] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:10.842015 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.842106 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.842202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] RBAC: Adding query filter params (name=reader) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:10.842202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:10.842202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1802a-244e-4688-a6b4-9eaa99c5d01f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:10.850859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 154/305] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:10.852149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe17c2-d97d-446b-8b92-6f947de46344 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.852445 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe17c2-d97d-446b-8b92-6f947de46344 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.852727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe17c2-d97d-446b-8b92-6f947de46344 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.853984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 155/306] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:10.854672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe17c2-d97d-446b-8b92-6f947de46344 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:10.941366 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fbed7-9293-4284-8bcc-d545bc04e7d6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.956732 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe17c2-d97d-446b-8b92-6f947de46344 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:10.975972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a92c7-dbda-47cb-bcb8-b4f4ba83d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.977335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a92c7-dbda-47cb-bcb8-b4f4ba83d75e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.977622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a92c7-dbda-47cb-bcb8-b4f4ba83d75e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.977908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a92c7-dbda-47cb-bcb8-b4f4ba83d75e None admin] PATH_INFO: `/v3/users/c8baa7c5c4b0436b93cc799c13dcdc40` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.979171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a92c7-dbda-47cb-bcb8-b4f4ba83d75e None admin] RBAC: Authorizing `identity:get_user(user_id=c8baa7c5c4b0436b93cc799c13dcdc40)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:10.980630 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a92c7-dbda-47cb-bcb8-b4f4ba83d75e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:10.987515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 152/307] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:10 2022] GET /identity/v3/users/c8baa7c5c4b0436b93cc799c13dcdc40 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:10.987515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.987515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.987515 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.993441 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:10.994108 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:10.994390 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:10.994664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] PATH_INFO: `/v3/groups` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:10.995388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:10.996872 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:11.001903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:11.003184 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:11.013368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 156/308] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:37:10 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:11.014495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.083674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:11.090691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 153/309] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:11.091397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.102512 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:11.160293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930111-64f7-4883-8de1-b1866db268ac None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.198689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.199594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.199880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.200161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] PATH_INFO: `/v3/users/f39c0bf5eea24abaa21e241918f8f299` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:11.206925 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1d3fc-a953-4942-b2b7-ec0ee8afeb27 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.215769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f39c0bf5eea24abaa21e241918f8f299)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:11.217273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:11.222877 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 157/310] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:11 2022] GET /identity/v3/users/f39c0bf5eea24abaa21e241918f8f299 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:11.224360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.249041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.249905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.250190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.250465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] PATH_INFO: `/v3/system/users/c8baa7c5c4b0436b93cc799c13dcdc40/roles/2816caba47884002a96dab7b07f4bac4` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:11.252560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8baa7c5c4b0436b93cc799c13dcdc40, role_id=2816caba47884002a96dab7b07f4bac4)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:11.253946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:11.263519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 154/311] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:37:11 2022] PUT /identity/v3/system/users/c8baa7c5c4b0436b93cc799c13dcdc40/roles/2816caba47884002a96dab7b07f4bac4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:11.264453 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.339192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:11.374107 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d01878-875a-480b-bbf3-41a2753400e8 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.395431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:11.396691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438512d-8334-4a9b-ae3b-1728e2dfe1b1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.430256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.432329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.433134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.433606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:11.437220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.437812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.438201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.438588 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:11.440144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] RBAC: Adding query filter params (role.id=9afe1d161ebd4d80b0f0f62e206cacc9, user.id=f39c0bf5eea24abaa21e241918f8f299, scope.system=all) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:11.440556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:11.442115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:11.449828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:11.454825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 155/312] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:37:11 2022] GET /identity/v3/role_assignments?user.id=f39c0bf5eea24abaa21e241918f8f299&scope.system=all&role.id=9afe1d161ebd4d80b0f0f62e206cacc9 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:11.458730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:11.459980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:11.461061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:11.463527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 158/313] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:11.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.591804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e12a2-1abb-4573-b6c4-9853de5f90b4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.622124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:11.632168 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.632859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.633148 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.633426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:11.634190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] RBAC: Adding query filter params (name=reader) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:11.634499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:11.635935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:11.645912 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 156/314] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:11.651239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.767887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7e8f4-2066-4de1-9cc8-b01106093c78 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.808842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.809736 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.810024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.810304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] PATH_INFO: `/v3/users/f1e69d22e61d4942854efcc31301481b` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:11.811582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] RBAC: Authorizing `identity:get_user(user_id=f1e69d22e61d4942854efcc31301481b)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:11.813118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:11.815131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 159/315] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:11 2022] GET /identity/v3/users/f1e69d22e61d4942854efcc31301481b => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:11.820526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:11.929546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27adac6-323a-49b6-b0fd-13a93862103d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:11.967140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:11.967805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:11.968094 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:11.968376 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:12.042589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:12.044058 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:12.047181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:12.153573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 157/316] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:12.159412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:12.203259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:12.268033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea6e9-6314-4026-b666-575e057af19e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:12.303606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada7d44-2574-481d-bf6e-9061020801ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:12.304401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada7d44-2574-481d-bf6e-9061020801ed None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:12.304689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada7d44-2574-481d-bf6e-9061020801ed None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:12.304967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada7d44-2574-481d-bf6e-9061020801ed None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:12.306184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada7d44-2574-481d-bf6e-9061020801ed None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:12.307695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada7d44-2574-481d-bf6e-9061020801ed None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:12.309749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 160/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:12 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:12.315691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:12.407242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:12.420522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70c6b-1742-49b3-a223-059690ce8d17 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:12.458540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:12.459546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:12.460044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:12.460512 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:12.461536 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] RBAC: Adding query filter params (role.id=9afe1d161ebd4d80b0f0f62e206cacc9, scope.project.id=935d2d3fa1384ca8917811ee8310cc09, user.id=f1e69d22e61d4942854efcc31301481b) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:12.462041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:12.463757 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00454fe-c834-4211-857a-7698d4ebf864 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:12.471357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 158/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:12 2022] GET /identity/v3/role_assignments?user.id=f1e69d22e61d4942854efcc31301481b&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=9afe1d161ebd4d80b0f0f62e206cacc9 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:13.403434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6acdc-fcbc-49dd-a08f-4ff431d3b034 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.403987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6acdc-fcbc-49dd-a08f-4ff431d3b034 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.403987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6acdc-fcbc-49dd-a08f-4ff431d3b034 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.405535 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 161/319] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:13.411382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad233f8-ad9d-490d-b318-ac7a4c87850a None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.411801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad233f8-ad9d-490d-b318-ac7a4c87850a None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.411996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad233f8-ad9d-490d-b318-ac7a4c87850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.430158 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-fad233f8-ad9d-490d-b318-ac7a4c87850a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:13.431542 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-fad233f8-ad9d-490d-b318-ac7a4c87850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:13.501480 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 159/320] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:13.523995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6acdc-fcbc-49dd-a08f-4ff431d3b034 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:13.625695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093ad3-bf7f-42b8-8cef-995194142f64 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.626054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093ad3-bf7f-42b8-8cef-995194142f64 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.626290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093ad3-bf7f-42b8-8cef-995194142f64 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.627999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 160/321] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:13.632897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216a313-b9a0-4e8c-975e-fbc9d102b703 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.633188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216a313-b9a0-4e8c-975e-fbc9d102b703 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.633468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216a313-b9a0-4e8c-975e-fbc9d102b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.634320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6acdc-fcbc-49dd-a08f-4ff431d3b034 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:13.645708 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:13.655147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-c216a313-b9a0-4e8c-975e-fbc9d102b703 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:13.656403 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-c216a313-b9a0-4e8c-975e-fbc9d102b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:13.672693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:13.673492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.673780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.674059 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.675256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:13.676713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:13.678393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 162/322] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:13.684651 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:13.741747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 161/323] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:13.744996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad94c2-aa36-4ef4-a2b4-542f16b76440 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.745290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad94c2-aa36-4ef4-a2b4-542f16b76440 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.745574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad94c2-aa36-4ef4-a2b4-542f16b76440 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.750660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 162/324] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:13.752194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.752520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.752768 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.769492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:13.770691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:13.778208 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:13.800737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aefcbc-cf23-4e5c-8a87-8d5023435081 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:13.834024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:13.834682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:13.834996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:13.835274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] PATH_INFO: `/v3/groups` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:13.835963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:13.836714 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 163/325] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:13.837444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:13.837630 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:13.860184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 163/326] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:37:13 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:37:13.860721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:13.902464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:13.961124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a79339-a3e1-4f3c-b3f0-d2befa114747 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:13.978751 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce59ce-ff63-42f8-9c0e-2e89a83edbbd None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.000181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.000993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.002711 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.003090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.015695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:14.018730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.019682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.019980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.020317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:14.024612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:14.025750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:14.026712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 164/327] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:14.034142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:14.035657 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:14.037187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:14.047024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:14.048103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:14.051868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 164/328] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:14.054436 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:14.169577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:14.176934 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295a1a-d9cd-4380-b3f9-b001b143c4c9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.181991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bfcf9-caaf-4247-b0c3-57babf55c2d6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.220850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.221526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.221816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.222097 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.222891 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:14.223016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.223232 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:14.223703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.223983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.224262 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.224616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:14.225084 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:14.225394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:14.226755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:14.234595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 165/329] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:14.240442 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:14.242192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 165/330] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:14.248841 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:14.331224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:14.383126 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b16924-c581-4f24-8141-a3172ca12e9b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.386931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832d00-67a7-4aa5-b095-bce56bbdd72d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.433845 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.434746 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.435082 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.435363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] PATH_INFO: `/v3/users/c8baa7c5c4b0436b93cc799c13dcdc40` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.435761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.436607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=c8baa7c5c4b0436b93cc799c13dcdc40)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:14.437380 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.437882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.438075 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:14.438551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] PATH_INFO: `/v3/users/f39c0bf5eea24abaa21e241918f8f299` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.440630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] RBAC: Authorizing `identity:get_user(user_id=f39c0bf5eea24abaa21e241918f8f299)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:14.440757 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 166/331] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:14 2022] GET /identity/v3/users/c8baa7c5c4b0436b93cc799c13dcdc40 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:14.442485 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:14.444740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 166/332] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:14 2022] GET /identity/v3/users/f39c0bf5eea24abaa21e241918f8f299 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:14.446303 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:14.450109 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:14.482618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:14.571326 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03379cc1-22dd-401a-9b48-dd63ffa5b2fd None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.585024 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29955a-2ec5-4156-b078-868fcc60f9d6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:14.614921 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e775bd4-dcd5-4a56-840e-9534f212ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.616205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775bd4-dcd5-4a56-840e-9534f212ef54 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.616713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775bd4-dcd5-4a56-840e-9534f212ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.617209 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775bd4-dcd5-4a56-840e-9534f212ef54 None admin] PATH_INFO: `/v3/system/users/f39c0bf5eea24abaa21e241918f8f299/roles/9afe1d161ebd4d80b0f0f62e206cacc9` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.619149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e775bd4-dcd5-4a56-840e-9534f212ef54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f39c0bf5eea24abaa21e241918f8f299, role_id=9afe1d161ebd4d80b0f0f62e206cacc9)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:14.621071 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e775bd4-dcd5-4a56-840e-9534f212ef54 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:14.623586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:14.632334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 167/333] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:37:14 2022] PUT /identity/v3/system/users/f39c0bf5eea24abaa21e241918f8f299/roles/9afe1d161ebd4d80b0f0f62e206cacc9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:14.634004 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:14.634687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:14.635001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:14.635285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:14.636207 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] RBAC: Adding query filter params (role.id=2816caba47884002a96dab7b07f4bac4, user.id=c8baa7c5c4b0436b93cc799c13dcdc40, scope.system=all) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:14.636511 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:14.637988 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a192b3-880e-4aa1-b428-cd8e69a774b9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:14.656956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 167/334] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:37:14 2022] GET /identity/v3/role_assignments?user.id=c8baa7c5c4b0436b93cc799c13dcdc40&scope.system=all&role.id=2816caba47884002a96dab7b07f4bac4 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:16.800362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628784-ef2f-4aba-b84d-8a5550e9a6b6 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:16.800923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628784-ef2f-4aba-b84d-8a5550e9a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:16.800923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628784-ef2f-4aba-b84d-8a5550e9a6b6 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:16.802572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 168/335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:16.807783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacff97-aca9-4a54-810f-4215fb21ddc5 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:16.808297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacff97-aca9-4a54-810f-4215fb21ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:16.808470 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacff97-aca9-4a54-810f-4215fb21ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:16.827799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-3eacff97-aca9-4a54-810f-4215fb21ddc5 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:16.829000 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-3eacff97-aca9-4a54-810f-4215fb21ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:16.913943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 168/336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:16.957534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628784-ef2f-4aba-b84d-8a5550e9a6b6 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.021756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247723-95b5-4ee2-afb5-ae12ceee25da None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.022132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247723-95b5-4ee2-afb5-ae12ceee25da None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.022316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247723-95b5-4ee2-afb5-ae12ceee25da None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.024463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 169/337] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:17.031665 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.031971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.032216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.075165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:17.076314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:17.124228 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:17.152701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628784-ef2f-4aba-b84d-8a5550e9a6b6 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:17.212266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:17.213266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.213555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.213835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.214234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 170/338] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:17.225805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:17.234065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:17.235072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:17.235999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:17.236673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 169/339] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:17.242271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.264011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.345255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:17.406816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661fa87-c6b5-4815-abe1-7e97c2b44086 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:17.425464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa30c6-6734-4d2c-b42e-4cf80f56a646 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:17.444229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:17.444909 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.445243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.445566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.446288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:17.446599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:17.448046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c959e-d35d-4d5e-9d6a-c6d4065d5807 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:17.460178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 171/340] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:17.461522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caaeab-e19f-49e1-bb02-7012ceeb4ccd None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.461813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caaeab-e19f-49e1-bb02-7012ceeb4ccd None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.462095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caaeab-e19f-49e1-bb02-7012ceeb4ccd None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.463643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 172/341] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:17.465556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caaeab-e19f-49e1-bb02-7012ceeb4ccd None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.486396 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf038-d5c1-47f3-b17a-fa3353e32586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:17.487589 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf038-d5c1-47f3-b17a-fa3353e32586 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.488091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf038-d5c1-47f3-b17a-fa3353e32586 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.488541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf038-d5c1-47f3-b17a-fa3353e32586 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.507383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cf038-d5c1-47f3-b17a-fa3353e32586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d70cf038-d5c1-47f3-b17a-fa3353e32586 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:17.515908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:17.517507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:17.518402 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:17.527239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 170/342] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:17.528899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.529404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.529875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.556471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:17.558020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:17.564912 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:17.589806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caaeab-e19f-49e1-bb02-7012ceeb4ccd None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:17.608186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:17.655447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:17.656485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.658534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.659133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.691555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 171/343] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:17.692984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.800823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:17.801531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:17.822984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a00590-6b86-4d50-a0d3-50cad4022c42 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:17.872371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:17.873419 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:17.874058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:17.874345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:17.875191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:17.875505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:17.877578 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:17.896112 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 172/344] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:17.896993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.903844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:17.962063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 173/345] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:37:17.964145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:17.980017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.029076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc2c46-8d42-4f3d-b090-8b35e5a1a9ea None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.074394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded2b66-a965-4548-bb44-d15ac5958056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.075423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded2b66-a965-4548-bb44-d15ac5958056 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.075712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded2b66-a965-4548-bb44-d15ac5958056 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.075992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded2b66-a965-4548-bb44-d15ac5958056 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.089300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a87442-e83c-43d7-9a28-93c7c724e5e4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.094083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded2b66-a965-4548-bb44-d15ac5958056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2ded2b66-a965-4548-bb44-d15ac5958056 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:18.104929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:18.105943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:37:18.106986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:18.108721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 173/346] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:18.110009 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a211c-94fe-432f-9000-e379559636e5 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.110299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a211c-94fe-432f-9000-e379559636e5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.111242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a211c-94fe-432f-9000-e379559636e5 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.112547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 174/347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:18.113244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a211c-94fe-432f-9000-e379559636e5 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.134579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371be0c-0581-4264-926a-0346ae71fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.135437 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371be0c-0581-4264-926a-0346ae71fe69 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.136530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371be0c-0581-4264-926a-0346ae71fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.136820 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371be0c-0581-4264-926a-0346ae71fe69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.203897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.218478 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371be0c-0581-4264-926a-0346ae71fe69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:18.219776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371be0c-0581-4264-926a-0346ae71fe69 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:18.242046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.278533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a211c-94fe-432f-9000-e379559636e5 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.328280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.329154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.329771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.330050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.331303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:18.332783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:18.334828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 175/348] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:18.335623 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.368957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 174/349] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:18.370401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.370686 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.370992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.390753 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:18.391948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:18.456944 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616cdb-e308-4926-ab44-b4ab4f611675 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.466120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 175/350] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:18.467095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.514412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.519597 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.519794 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.520446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.520737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.521095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.522122 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:18.522443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:18.523919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:18.539315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 176/351] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:18.540183 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.589563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0daa1d-9a65-4e09-a64f-b697aa43d3b2 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.629285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.630151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.630435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.630715 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.637499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:18.639081 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:18.641010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 176/352] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:18.646505 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.653734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05bdaa-8e13-4ba6-a9da-28903a23cf79 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.696551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.697421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.697804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.698085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.699436 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:18.701025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:18.703725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 177/353] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:18.704692 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.769791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018667-ae86-43ce-b65f-e6c0f6d89f41 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.776645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.795806 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:18.820120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.822741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.822741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.822741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.837576 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:18.846133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:18.847269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 177/354] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:18.848886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.859242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c41be1-bfa5-4807-b9e7-5ac2c3d57b30 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:18.915020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:18.915815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:18.916153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:18.916412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] PATH_INFO: `/v3/users/f39c0bf5eea24abaa21e241918f8f299` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:18.918193 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] RBAC: Authorizing `identity:get_user(user_id=f39c0bf5eea24abaa21e241918f8f299)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:18.919718 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:18.921562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 178/355] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/users/f39c0bf5eea24abaa21e241918f8f299 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:18.922154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:18.990664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ee1e-d737-435a-8433-7b319fe7e712 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.037032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.038037 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.038512 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.039015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.040060 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=1c9f3c82497249eabf902ceb21d001b3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:19.040567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:19.042253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0040c5-59b1-4eb5-9934-c691f411945e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:19.053310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 178/356] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=2816caba47884002a96dab7b07f4bac4 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:19.056427 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ae2a-fa1f-42b6-a95d-75687ece69bb None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.056978 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ae2a-fa1f-42b6-a95d-75687ece69bb None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.057457 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ae2a-fa1f-42b6-a95d-75687ece69bb None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.059111 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 179/357] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:19.060238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ae2a-fa1f-42b6-a95d-75687ece69bb None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:19.065589 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794353c2-fe11-4437-b452-393084a0e32f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.103543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:19.106315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:19.114761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.115687 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.115969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.116244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.118668 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:19.119434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:19.121820 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 179/358] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:18 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:19.122522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:19.214086 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ae2a-fa1f-42b6-a95d-75687ece69bb None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.259881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.260712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.260986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.261263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.264551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:19.264551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:19.264551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0d2f-39e2-498d-bd22-9fe1748031d9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:19.271538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75116b-fd7c-408e-bbb9-1f9990ee7fa0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.276094 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 180/359] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:19.281660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.281660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.281660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.299239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:19.300444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:19.319830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.321104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.321622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.322127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.323217 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] RBAC: Adding query filter params (role.id=9afe1d161ebd4d80b0f0f62e206cacc9, user.id=f39c0bf5eea24abaa21e241918f8f299, scope.system=all) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:19.323735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:19.325420 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d236cc-e8d7-4fef-8b99-17cab39f4ddd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:19.341128 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 180/360] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/role_assignments?user.id=f39c0bf5eea24abaa21e241918f8f299&scope.system=all&role.id=9afe1d161ebd4d80b0f0f62e206cacc9 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:19.343318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1ae6d-d823-40ad-8257-3d1728c655b8 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.344105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1ae6d-d823-40ad-8257-3d1728c655b8 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.345712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1ae6d-d823-40ad-8257-3d1728c655b8 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.347429 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 181/361] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:19.348117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1ae6d-d823-40ad-8257-3d1728c655b8 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:19.400624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 181/362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:19.401657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:19.420288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:19.431971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:19.516284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1ae6d-d823-40ad-8257-3d1728c655b8 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.555682 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ab0b-3279-4ede-9809-702f42261c18 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.567243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.568196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.568550 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.568896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.570028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=1c9f3c82497249eabf902ceb21d001b3) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:19.570304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:19.571942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59794-5847-442c-89cf-f3c4fe03267d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:19.581795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 182/363] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:19.583323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.583644 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.583991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.603050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:19.604389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:19.608309 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.609305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.609590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.609867 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.703074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 183/364] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:19.704013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:19.710520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:19.712068 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:19.753722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:19.787270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:19.853128 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beef945-5392-4f85-b742-ebbea99a0083 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:19.873751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 182/365] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:19.879113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:19.898508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:19.899659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:19.899963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:19.900213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:19.912943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:19.921116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:19.922131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:19.923630 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 184/366] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:19.925116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.018031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cc21-5b80-48b4-a3a1-bf768f39e6c5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.046195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3bc43-4e50-483c-9fae-e4c1a2adbf2a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.052429 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.058725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.070689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.072469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.073215 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.073681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.087053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.087928 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.088212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.088488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.089715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.089834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:20.091219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:20.093250 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 185/367] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:20.094034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:20.103147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:20.104212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:20.105079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 183/368] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:20.110436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.236796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9235-8ba4-46a8-813b-60d58e9e9a85 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.247015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68b27-7b66-41e0-9378-13f1ca342bc5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.285147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.286182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.286677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.287211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.288221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:20.288828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.290729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:20.294717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.294717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.294717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.294717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.297050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.298889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:20.305277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 184/369] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:20.305277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.309072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 186/370] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:20.310177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.361848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.367736 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.437984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ff212-8c00-4abb-b5f0-e9ebfe679f48 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.447350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402b07-cf83-4ff0-af77-2442c93da2ce None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.484283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.485137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.485424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.485738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.487090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:20.487534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.489175 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:20.491822 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.492750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.493259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.493842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.494974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=935d2d3fa1384ca8917811ee8310cc09) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:20.495514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.497186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:20.498475 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 185/371] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:20.499165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.506407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 187/372] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=2816caba47884002a96dab7b07f4bac4 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:20.507580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.623070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5db8-01df-4f5b-9cbd-a0704d689787 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.639172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.666102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.667077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.667356 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.750013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.752105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:20.815960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d42d5-fbbb-4e3b-bd40-d9fc512aaec4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:20.818164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.864876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:20.865680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:20.866069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:20.866454 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:20.882777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 186/373] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:20.888023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:20.916270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:20.958354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:20.960409 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.020761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220a7b-928a-4ecb-924e-09e7d8d40819 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:21.064840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:21.066207 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.066543 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.066772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.068405 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:21.070448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.073353 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 187/374] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:21.083894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:21.087121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 188/375] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:21.092371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:21.094426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:21.175153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:21.199402 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb1cc6-b14a-4bce-add4-9b270e5185da None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:21.236522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:21.237673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.238130 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.238564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.239963 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:21.241554 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.244811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 188/376] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:21 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:21.250349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:21.253432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3ba5-8e9e-43b1-ac3b-fdc2911f7eab None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:21.329238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:21.330163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.330443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.330825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] PATH_INFO: `/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.333218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] RBAC: Authorizing `identity:get_project(project_id=24cf476ac4ff41ea8154c8b198b8ae32)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:21.334701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.336467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 189/377] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:21 2022] GET /identity/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:21.342538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:21.444224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c0841-f260-4a46-b8ec-b8d6e59a3583 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:21.482130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:21.513650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:21.514314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.514600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.514901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.515746 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=935d2d3fa1384ca8917811ee8310cc09) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:21.516057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:21.518653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.527936 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 189/378] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:21 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:21.534517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823a0a-ad77-4374-9a94-c5ee1b425a6a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:21.581270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251e4c9-2d8c-4fc1-a82a-44584782cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:21.582219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e4c9-2d8c-4fc1-a82a-44584782cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.582505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e4c9-2d8c-4fc1-a82a-44584782cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.582860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e4c9-2d8c-4fc1-a82a-44584782cbd6 None admin] PATH_INFO: `/v3/groups/b7fc8cf01dee41718e0841f66bb93b29` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.590155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251e4c9-2d8c-4fc1-a82a-44584782cbd6 None admin] RBAC: Authorizing `identity:get_group(group_id=b7fc8cf01dee41718e0841f66bb93b29)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:21.591824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251e4c9-2d8c-4fc1-a82a-44584782cbd6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.594012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 190/379] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:21 2022] GET /identity/v3/groups/b7fc8cf01dee41718e0841f66bb93b29 => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:21.603333 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:21.624452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:21.789950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2928-bd7a-4d0c-a4be-e8408a4e6233 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.790151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2928-bd7a-4d0c-a4be-e8408a4e6233 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.790410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2928-bd7a-4d0c-a4be-e8408a4e6233 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.798916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 191/380] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:21.799996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.800280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.800553 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.809315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba460cb-fd02-443a-a984-2e137769dc84 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:21.824056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:21.825640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:21.863773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:21.864441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:21.864725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:21.865003 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:21.865848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] RBAC: Adding query filter params (group.id=b7fc8cf01dee41718e0841f66bb93b29, role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=24cf476ac4ff41ea8154c8b198b8ae32) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:21.866160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:21.868617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:21.886844 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 190/381] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:21 2022] GET /identity/v3/role_assignments?group.id=b7fc8cf01dee41718e0841f66bb93b29&scope.project.id=24cf476ac4ff41ea8154c8b198b8ae32&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:21.956367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 192/382] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:22.000602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:22.141396 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:22.199332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbaed6-3aa0-4b7e-b4b5-25563380dc5d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:22.244234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:22.245370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:22.245845 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:22.246298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:22.257787 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:22.265935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:22.267523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:22.268432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:22.271389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 191/383] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:22.280124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:22.392567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:22.435367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c93622-d0df-4a0f-aac0-bf046a48c863 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:22.478560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:22.479274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:22.479562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:22.479838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:22.480638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] RBAC: Adding query filter params (name=member) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:22.481036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:22.482564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:22.492308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 193/384] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:22.498139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:22.606246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b9220-ae36-452f-b953-e11dca2c1c27 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:22.642323 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:22.643270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:22.643498 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:22.643773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:22.644980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:22.646428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:22.648413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 192/385] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:22 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:22.653943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:22.765873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76a4c-3b71-4562-b584-69e92d21e760 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:22.792372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:22.801785 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c5017-3877-4c40-aab4-491747d21450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:22.802778 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5017-3877-4c40-aab4-491747d21450 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:22.803083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5017-3877-4c40-aab4-491747d21450 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:22.803359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5017-3877-4c40-aab4-491747d21450 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:22.804652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c5017-3877-4c40-aab4-491747d21450 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:22.806186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c5017-3877-4c40-aab4-491747d21450 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:22.808285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 194/386] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:22 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:22.814533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:22.818839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:22.826746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b28db-1460-47b6-af1f-8e9c08412d38 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:22.827065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b28db-1460-47b6-af1f-8e9c08412d38 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:22.827340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b28db-1460-47b6-af1f-8e9c08412d38 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:22.833129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 195/387] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:22.834458 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:22.834748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:22.835055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:22.856225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:22.857703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:22.942491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 196/388] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:22.987041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:23.008928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c5dd0-efa4-468d-b355-a223c200b73a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:23.081371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:23.082264 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:23.082547 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:23.082842 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/2816caba47884002a96dab7b07f4bac4` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:23.089185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f3c82497249eabf902ceb21d001b3, group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role_id=2816caba47884002a96dab7b07f4bac4)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:23.090646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:23.126744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 193/389] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:37:22 2022] PUT /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/2816caba47884002a96dab7b07f4bac4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:23.164607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361e3d-29a4-431a-a8fb-514b150a4fb1 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:23.199660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:23.214140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:23.214995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:23.215280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:23.215556 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:23.227857 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:23.237092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:23.239529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:23.241565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 197/390] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:23.248291 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:23.359487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:23.402503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7eee4-6596-4cbb-9986-9117f8a48161 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:23.444872 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:23.445602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:23.445892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:23.446169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:23.447087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:23.447397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:23.448804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:23.459167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 194/391] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:23.464531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:23.575818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d60d8-b7c2-4f84-89a9-d735ea801e76 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:23.611936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:23.612807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:23.613091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:23.613371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:23.614679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:23.616080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:23.618042 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 198/392] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:23 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:23.623377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:23.743785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78e98-b459-4868-a44b-e2bfce3ef35c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:23.776942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:23.786758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94669b6e-8c08-4b3b-b163-b5e9f43572d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:23.787664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669b6e-8c08-4b3b-b163-b5e9f43572d0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:23.787949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669b6e-8c08-4b3b-b163-b5e9f43572d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:23.788226 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669b6e-8c08-4b3b-b163-b5e9f43572d0 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:23.789437 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94669b6e-8c08-4b3b-b163-b5e9f43572d0 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:23.792902 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94669b6e-8c08-4b3b-b163-b5e9f43572d0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:23.794979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 195/393] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:23 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:23.803843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:23.867885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:23.923298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c5c9-1c82-48db-9251-782cf3171b14 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:23.967471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34494ada-a232-4bd6-9a19-0625e23c43fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:23.968759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34494ada-a232-4bd6-9a19-0625e23c43fb None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:23.969259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34494ada-a232-4bd6-9a19-0625e23c43fb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:23.969787 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34494ada-a232-4bd6-9a19-0625e23c43fb None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:23.976664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34494ada-a232-4bd6-9a19-0625e23c43fb None admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f3c82497249eabf902ceb21d001b3, group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:23.978471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34494ada-a232-4bd6-9a19-0625e23c43fb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:24.012949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 199/394] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:37:23 2022] PUT /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/0cebdd5895894be58dd945aadfab5e3f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:24.299186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa25374-1893-444e-96f8-b1c261abbc09 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.299725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa25374-1893-444e-96f8-b1c261abbc09 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.299725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa25374-1893-444e-96f8-b1c261abbc09 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.301391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 196/395] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:24.307494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e5ba-3ef8-4c49-8057-a6da9977c269 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.307790 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e5ba-3ef8-4c49-8057-a6da9977c269 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.308073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e5ba-3ef8-4c49-8057-a6da9977c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.326266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-b5c0e5ba-3ef8-4c49-8057-a6da9977c269 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:24.327507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-b5c0e5ba-3ef8-4c49-8057-a6da9977c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:24.413417 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 200/396] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:24.457502 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa25374-1893-444e-96f8-b1c261abbc09 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:24.600294 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa25374-1893-444e-96f8-b1c261abbc09 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:24.600666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156702f-57ff-456d-85a0-50b84da06120 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.601104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156702f-57ff-456d-85a0-50b84da06120 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.601192 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156702f-57ff-456d-85a0-50b84da06120 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.602943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 201/397] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:24.615425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25cda-d395-40f6-9500-73f24cb8730a None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.616000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25cda-d395-40f6-9500-73f24cb8730a None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.616488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25cda-d395-40f6-9500-73f24cb8730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.640251 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:24.646809 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.646809 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.646809 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] PATH_INFO: `/v3/roles/member` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.653165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:24.654372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-37c25cda-d395-40f6-9500-73f24cb8730a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:24.655812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-37c25cda-d395-40f6-9500-73f24cb8730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:24.661801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:24.662810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:24.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 197/398] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:24.669668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:24.723290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:24.749462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:24.762623 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 202/399] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:24.784793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98c21-6525-4000-b96e-f69f41d077ca None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.785142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98c21-6525-4000-b96e-f69f41d077ca None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.785374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98c21-6525-4000-b96e-f69f41d077ca None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.787044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 203/400] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:24.789238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98c21-6525-4000-b96e-f69f41d077ca None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:24.800282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1805f70-8f6f-4a66-8ae1-7018113dcadb None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:24.837502 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:24.838282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.838577 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.838890 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.839653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:24.839964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:24.841476 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28debf-d106-4d17-8a04-37ffa6c13998 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:24.851579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 198/401] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:24.852765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.853056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.853335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.872166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:24.873397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:24.906505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98c21-6525-4000-b96e-f69f41d077ca None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:24.944447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:24.945251 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:24.945532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:24.945813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:24.951825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 199/402] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:24.952695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:24.959456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:24.967555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:24.969830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:24.972440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 204/403] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:24.981142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.002850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.020962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.074908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc065d02-43e4-4183-84d5-08a559cc47c3 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.113382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.114321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.114697 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.115100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.116475 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.118057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.124652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 200/404] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:24 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.125636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.127723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a45d-f610-4c8a-8354-f783e75071cc None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.173144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.174092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.174480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.174917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.175774 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:25.176280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.177914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.187599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 205/405] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.188685 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.254084 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cd256-1fdb-4e81-9dc1-26bef5f36598 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.270401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.295605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.296580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.296869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.297151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.307113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.311927 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:25.319783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47e65c-e0c1-42d6-bad0-0295ff630cd6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:25.321467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:25.322678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:25.323709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:25.326186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 201/406] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:25.327259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.365134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.365922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.366213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.366491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.367733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.369203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.375881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 206/407] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.375881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.439969 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e70c5-657b-48ec-aa08-d7e7027ebb8f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.484731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.486002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.486507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.487045 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] PATH_INFO: `/v3/groups/b7fc8cf01dee41718e0841f66bb93b29` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.488453 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] RBAC: Authorizing `identity:get_group(group_id=b7fc8cf01dee41718e0841f66bb93b29)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.490116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.492301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 202/408] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/groups/b7fc8cf01dee41718e0841f66bb93b29 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.493341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.520770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620f2d8-050a-411d-8fc8-29a6f3b10e0a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.542647 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.565304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.567028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.567542 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.568036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.569235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:25.569750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.572272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.595353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 207/409] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.596917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.608326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3780b-dd70-49e5-b1b7-06291a1af5aa None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.628245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.657608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.658860 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.659881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.660358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/2816caba47884002a96dab7b07f4bac4` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.663506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] RBAC: Authorizing `identity:create_grant(project_id=935d2d3fa1384ca8917811ee8310cc09, group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role_id=2816caba47884002a96dab7b07f4bac4)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.665669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.691402 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 203/410] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:37:25 2022] PUT /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/2816caba47884002a96dab7b07f4bac4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:25.693787 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.745816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f8b8-91d3-4175-85b3-335cfe158545 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.814915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.815803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.817545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.817842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] PATH_INFO: `/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.820024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] RBAC: Authorizing `identity:get_project(project_id=24cf476ac4ff41ea8154c8b198b8ae32)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.821527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.831364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 208/411] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.833289 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:25.914556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f29ae-0126-44bc-a0c3-69db61aba700 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.916731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.958650 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:25.972195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bbf03-abdb-447d-9de7-75e4cb64ab7f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:25.978081 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:25.979276 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:25.979724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:25.980106 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:25.981994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:25.983881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:25.986966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 204/412] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:25.992036 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:26.028368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c972c9-41fb-4a06-aac8-22fe25584239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:26.029777 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c972c9-41fb-4a06-aac8-22fe25584239 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.032354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c972c9-41fb-4a06-aac8-22fe25584239 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.035617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c972c9-41fb-4a06-aac8-22fe25584239 None admin] PATH_INFO: `/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32/groups/b7fc8cf01dee41718e0841f66bb93b29/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.039065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c972c9-41fb-4a06-aac8-22fe25584239 None admin] RBAC: Authorizing `identity:create_grant(project_id=24cf476ac4ff41ea8154c8b198b8ae32, group_id=b7fc8cf01dee41718e0841f66bb93b29, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:26.040804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c972c9-41fb-4a06-aac8-22fe25584239 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:26.065610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 209/413] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:37:25 2022] PUT /identity/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32/groups/b7fc8cf01dee41718e0841f66bb93b29/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:26.145240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108c40-83c5-47a9-bdc7-e9102f1171c9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:26.193804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:26.195070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.195581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.196059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.199702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:26.201203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:26.201830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42217e99-db6a-4217-a6ca-14ede53dc836 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.202325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42217e99-db6a-4217-a6ca-14ede53dc836 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.202829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42217e99-db6a-4217-a6ca-14ede53dc836 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.203372 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 205/414] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:25 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:26.205313 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 210/415] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:26.209564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:26.221784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.222118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.222350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.249749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:26.251692 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:26.298632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:26.377372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 211/416] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:26.395429 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5aa8-75dc-4f40-a88b-f548c8074b79 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:26.401316 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:26.434840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:26.436096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.436606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.437107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.440433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] RBAC: Authorizing `identity:create_grant(project_id=935d2d3fa1384ca8917811ee8310cc09, group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:26.442105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:26.459103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 206/417] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:37:26 2022] PUT /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6/roles/0cebdd5895894be58dd945aadfab5e3f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:26.509056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:26.533961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835d3ae-4b9a-4db4-9dbb-78add4449ab6 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:26.577021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81099e-c4b3-42f0-9d40-e04de8647530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:26.578222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81099e-c4b3-42f0-9d40-e04de8647530 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.578708 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81099e-c4b3-42f0-9d40-e04de8647530 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.579318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81099e-c4b3-42f0-9d40-e04de8647530 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.591975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81099e-c4b3-42f0-9d40-e04de8647530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-bc81099e-c4b3-42f0-9d40-e04de8647530 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:26.600354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:26.601397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:26.602284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:26.604749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 212/418] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:26.612116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:26.733293 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:26.736665 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212884bd-64db-4f78-bd26-54b63b9dc046 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:26.777726 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:26.778396 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.778676 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.778980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.779731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:26.780035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:26.781410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:26.790277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a202f-f817-42df-a80e-08937ab32f5b None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.790832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a202f-f817-42df-a80e-08937ab32f5b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.790832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a202f-f817-42df-a80e-08937ab32f5b None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.792211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 213/419] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:26.795679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 207/420] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:26.797540 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:26.797827 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:26.798673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:26.803011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:26.817680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:26.818961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:26.972016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 214/421] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:26.981474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503333d3-5181-4377-a81a-e9aff6364321 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:26.998171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:27.066321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:27.067189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:27.067474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:27.067755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:27.111227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:27.119766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:27.144503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cfee3-79d0-4eac-b506-4bf70219950c None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:27.181678 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:27.182497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:27.182802 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:27.183089 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:27.194632 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:27.203191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:27.204960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:27.206115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 215/422] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:27.211747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:27.260111 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:27.261542 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:27.367117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a4e2-e75b-4c38-a432-f6e1acd3292c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:27.411386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:27.414688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:27.415901 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:27.416263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:27.416610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:27.417460 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:27.417841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:27.420105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:27.429640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 216/423] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:27.435514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:27.456652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 208/424] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:27.463766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:27.575259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:27.576567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209c0e4-2209-49a8-bace-002e4117cb35 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:27.631627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d540ce9-c850-4680-9f5e-806106e1f10f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:27.653079 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:27.653760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:27.654050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:27.654330 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:27.703412 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:27.704863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:27.705150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:27.705427 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:27.706748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:27.708220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:27.709940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 209/425] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:27 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:27.716729 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:27.753604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:27.761504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:27.763130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:27.878562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 217/426] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:27.885499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:27.950187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fab24-e38a-47d3-aa19-7b0d6e9e8e6d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.002753 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:28.021603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.022468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.022754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.023057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.025303 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:28.026773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:28.028965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 210/427] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:27 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:28.035201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:28.048616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:28.052735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c09f3-5fea-4010-b3d0-eb18b875e753 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.088943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.089814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.090100 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.090375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] PATH_INFO: `/v3/projects/1c9f3c82497249eabf902ceb21d001b3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.091620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] RBAC: Authorizing `identity:get_project(project_id=1c9f3c82497249eabf902ceb21d001b3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:28.093089 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:28.095438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 218/428] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:27 2022] GET /identity/v3/projects/1c9f3c82497249eabf902ceb21d001b3 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:28.100800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:28.152389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc793-7cf2-4227-8b48-616e2446714e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.223585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.224269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.224559 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.224838 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.225696 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=1c9f3c82497249eabf902ceb21d001b3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:28.226011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:28.227521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:28.234324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186106-4fb4-43b1-9f91-657f4cb4d779 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.248847 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 211/429] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:28 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=2816caba47884002a96dab7b07f4bac4 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:28.280688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ebc34-5856-43b3-b025-a930e48cf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.281818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ebc34-5856-43b3-b025-a930e48cf72a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.282903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ebc34-5856-43b3-b025-a930e48cf72a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.283408 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ebc34-5856-43b3-b025-a930e48cf72a None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.284828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ebc34-5856-43b3-b025-a930e48cf72a None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:28.286535 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ebc34-5856-43b3-b025-a930e48cf72a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:28.294816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 219/430] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:28 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:28.295011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:28.403228 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d327-7f00-4710-8e5d-a5245d3546f8 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.403410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d327-7f00-4710-8e5d-a5245d3546f8 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.403719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d327-7f00-4710-8e5d-a5245d3546f8 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.405963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 220/431] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:37:28.413227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.413528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.413816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.414899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:28.434487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:28.436439 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:28.488041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:28.503467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746cf3a-004f-4bc3-9978-38f57c5439b6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.545531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.546211 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.546490 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.546767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.547536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 221/432] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:28.550472 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=1c9f3c82497249eabf902ceb21d001b3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:28.550472 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:28.552216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:28.561923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 212/433] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:28 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=1c9f3c82497249eabf902ceb21d001b3&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 611 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:28.585085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:28.720955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a2c65-4b80-432a-933a-d04572c599f6 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.762887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.763663 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.763954 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.764227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] PATH_INFO: `/v3/roles/member` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.778273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:28.786755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:28.787860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:28.789293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 222/434] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:28.796595 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:28.920696 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6f37c-4b40-484a-b678-ea44037d6d55 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:28.947140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:28.959608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:28.960280 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:28.960565 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:28.960842 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:28.961601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:28.961908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:28.963332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa280a8-facc-46a9-8600-a83d4f74d7b4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:28.973198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 213/435] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:37:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:28.978706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.003801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.008815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81b7d8-01ff-4465-8ed3-f858ee8b765b None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.009109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81b7d8-01ff-4465-8ed3-f858ee8b765b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.009391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81b7d8-01ff-4465-8ed3-f858ee8b765b None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.011328 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 214/436] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:29.017600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.017895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.018294 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.038807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:29.040032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:29.117547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e38a18-9b48-4bbb-9125-d3678dd4355a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.133963 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 215/437] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:29.158202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.166282 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc012c13-9cbe-4574-8562-32e1c1429294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc012c13-9cbe-4574-8562-32e1c1429294 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.167877 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc012c13-9cbe-4574-8562-32e1c1429294 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.168148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc012c13-9cbe-4574-8562-32e1c1429294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.270347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc012c13-9cbe-4574-8562-32e1c1429294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:29.271769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc012c13-9cbe-4574-8562-32e1c1429294 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:29.296791 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.297789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3d567-f315-4b8e-b38e-638900213ffb None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.316889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.335243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70db65-6d48-4b92-83e0-878db7f1f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.336018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70db65-6d48-4b92-83e0-878db7f1f32e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.336304 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70db65-6d48-4b92-83e0-878db7f1f32e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.336664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70db65-6d48-4b92-83e0-878db7f1f32e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.346653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70db65-6d48-4b92-83e0-878db7f1f32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-bb70db65-6d48-4b92-83e0-878db7f1f32e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:29.354334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:29.355380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:29.356271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 216/438] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:29.356998 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a00e-d719-4969-8a2e-bb32ddbc6390 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.356998 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a00e-d719-4969-8a2e-bb32ddbc6390 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.357789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a00e-d719-4969-8a2e-bb32ddbc6390 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.358970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 217/439] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:29.362214 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a00e-d719-4969-8a2e-bb32ddbc6390 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.378502 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 223/440] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:37:29.379833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.380125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.380405 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.396321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:29.397520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:29.463348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a00e-d719-4969-8a2e-bb32ddbc6390 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.464852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 224/441] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:29.465684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.498106 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.498773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.499076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.499355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.500110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:29.500420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:29.502406 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:29.510389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 218/442] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:29.510389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.524342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.551295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.576573 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7b359-6779-4f7a-88db-ee1b985f971d None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.613862 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.614885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.615166 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.615436 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.616640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:29.618090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88f09-1203-4b65-a076-1c5130f42413 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.618192 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:29.620008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 225/443] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:29.620589 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.657448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.658249 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.658531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.658821 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.669163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:29.677731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:29.678761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:29.679681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 219/444] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:29.680440 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.725480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf02a62-8384-4e88-bbfa-9ec837620d28 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.743858 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.761665 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.762314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.762600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.762911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.776213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.780517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632848c-25c7-4e87-9308-41fa04877404 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.814422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.815310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.815598 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.815887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.817083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:29.818580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:29.820250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 220/445] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:29.821015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.830956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:29.832752 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:29.921471 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326ac1-9138-46dc-a871-5d13c978b5c3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:29.931313 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 226/446] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:29.932194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:29.952829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:29.965375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:29.966049 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:29.966335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:29.966615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:29.967438 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:29.967747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:29.969128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:29.977644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 221/447] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:29.978432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.007215 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:30.052922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0302-3e33-4ee5-ab1f-ce10e59ac763 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.077383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed81f-e5f8-4495-a4df-a3f2e7965212 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.086799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.087597 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.087875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.088147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.088965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=2816caba47884002a96dab7b07f4bac4, scope.project.id=935d2d3fa1384ca8917811ee8310cc09) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:30.089271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.090721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.097173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 227/448] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=2816caba47884002a96dab7b07f4bac4 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:30.098039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.113766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.114970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.115458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.115740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] PATH_INFO: `/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.117090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] RBAC: Authorizing `identity:get_project(project_id=24cf476ac4ff41ea8154c8b198b8ae32)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.118596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.125048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 222/449] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:29 2022] GET /identity/v3/projects/24cf476ac4ff41ea8154c8b198b8ae32 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:30.126286 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.192987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:30.213168 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462c774-7473-442d-9a08-c7eda8bd5d3c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.236941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:30.243121 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533f9e-c0ff-42b5-ba8a-00a0d114a75a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.252361 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.253038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.253330 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.253613 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.290115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.291030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.291315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.291591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] PATH_INFO: `/v3/groups/b7fc8cf01dee41718e0841f66bb93b29` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.292877 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] RBAC: Authorizing `identity:get_group(group_id=b7fc8cf01dee41718e0841f66bb93b29)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.294354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.301183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 223/450] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:30 2022] GET /identity/v3/groups/b7fc8cf01dee41718e0841f66bb93b29 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:30.302683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.340598 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.340920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.423629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e55c7-2910-4572-8d5a-e38f575ff157 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.434943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:30.460895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 228/451] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:30.465278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.466348 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.467556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.467852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.468138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.468987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] RBAC: Adding query filter params (group.id=b7fc8cf01dee41718e0841f66bb93b29, role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=24cf476ac4ff41ea8154c8b198b8ae32) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:30.469308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.471385 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.478701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 224/452] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:30 2022] GET /identity/v3/role_assignments?group.id=b7fc8cf01dee41718e0841f66bb93b29&scope.project.id=24cf476ac4ff41ea8154c8b198b8ae32&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:30.576086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dabf25-9146-4264-9512-5e8be81fd281 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.612016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.612805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.613088 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.613360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] PATH_INFO: `/v3/projects/935d2d3fa1384ca8917811ee8310cc09` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.614606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] RBAC: Authorizing `identity:get_project(project_id=935d2d3fa1384ca8917811ee8310cc09)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.616125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.617946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 229/453] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:37:30 2022] GET /identity/v3/projects/935d2d3fa1384ca8917811ee8310cc09 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:30.623835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.654771 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:30.727710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3d9ed-e4fb-42a0-9b2c-3e016deefa5e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.760132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0f9d-c9b2-482f-a1c7-cb1831d3b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.760974 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0f9d-c9b2-482f-a1c7-cb1831d3b02b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.761257 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0f9d-c9b2-482f-a1c7-cb1831d3b02b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.761533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0f9d-c9b2-482f-a1c7-cb1831d3b02b None admin] PATH_INFO: `/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.762699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e0f9d-c9b2-482f-a1c7-cb1831d3b02b None admin] RBAC: Authorizing `identity:get_group(group_id=e18c4f5f3acd4e5fad9d16f6cec91ca6)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.764160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e0f9d-c9b2-482f-a1c7-cb1831d3b02b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.765779 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 225/454] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:37:30 2022] GET /identity/v3/groups/e18c4f5f3acd4e5fad9d16f6cec91ca6 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:30.773225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:30.822161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:30.873058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7607f-1d46-4156-9f59-793bdb1e8548 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:30.906088 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:30.906725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:30.907039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:30.907317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:30.908139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] RBAC: Adding query filter params (group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6, role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=935d2d3fa1384ca8917811ee8310cc09) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:30.908450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:30.909902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9cd8-1807-4cd2-9460-a3f05eeed99f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:30.915708 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 230/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:37:30 2022] GET /identity/v3/role_assignments?group.id=e18c4f5f3acd4e5fad9d16f6cec91ca6&scope.project.id=935d2d3fa1384ca8917811ee8310cc09&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:33.921778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700e61-266c-418e-be06-20b643522b79 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:33.923430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700e61-266c-418e-be06-20b643522b79 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:33.923967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700e61-266c-418e-be06-20b643522b79 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:33.926000 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 226/456] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:33.932631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:33.933205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:33.933205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:33.955177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:33.956395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:33.973071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a9d7-ace8-4a84-99bd-1e0245c9ba2c None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:33.973729 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a9d7-ace8-4a84-99bd-1e0245c9ba2c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:33.974218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a9d7-ace8-4a84-99bd-1e0245c9ba2c None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:33.976079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 227/457] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:33.982070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420e2c-bfaa-4a64-86f4-86b97c1f1c12 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:33.983034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420e2c-bfaa-4a64-86f4-86b97c1f1c12 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:33.983527 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420e2c-bfaa-4a64-86f4-86b97c1f1c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.018434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-a0420e2c-bfaa-4a64-86f4-86b97c1f1c12 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:34.019701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-a0420e2c-bfaa-4a64-86f4-86b97c1f1c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:34.065171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 231/458] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:34.093824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.132783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 228/459] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:34.134860 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72d07-6973-44a8-bbf6-e2f979bbee3a None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.135371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72d07-6973-44a8-bbf6-e2f979bbee3a None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.136005 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72d07-6973-44a8-bbf6-e2f979bbee3a None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.137825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 229/460] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:34.147964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.148526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.149016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.169681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:34.170935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:34.175749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.199189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.242841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505983-3efa-4442-af6c-55eb2bdd219b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.256985 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 230/461] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:34.258778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.293078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.293876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.294156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.294426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.305665 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.307371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:34.325437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:34.326447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:34.327654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:34.327654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:34.327654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:34.327654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:34.329686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 232/462] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:34.334829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.388719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a2f56-97dc-4c64-a612-43f62577ca5d None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.426979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.428115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.428569 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.428993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.437350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.441477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.443398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.443569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d44f-60d3-4425-84c6-fef8a2bfede6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:34.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:34.464778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:34.465957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:34.465957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:34.465957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:34.465957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:34.472529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 231/463] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:34.473611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.483469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.484489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.484923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.485890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.487522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.497380 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.499237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:34.517761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:34.518749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:34.520005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:34.520005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:34.520005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:34.520005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:34.522057 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 233/464] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:34.523095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.590288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbd41a-8f4f-43c4-8a87-54a275d8d762 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.625300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.626002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.626284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.626558 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.627311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:34.627611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.628994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.635777 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba4150-a93d-4dc4-8a3c-240ad03615a4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.641348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 232/465] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:34.642540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.677511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.678169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.678451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.678718 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.679465 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:34.679767 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.681158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b81199-d5cb-455f-bfb2-382f92c1a320 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.695169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 234/466] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:34.697269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101df55-bea8-4989-8314-ff73bf417dda None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.697652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101df55-bea8-4989-8314-ff73bf417dda None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.698009 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101df55-bea8-4989-8314-ff73bf417dda None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.700731 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 235/467] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:34.700731 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101df55-bea8-4989-8314-ff73bf417dda None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.712503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.718091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.754446 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229ca09-cfb3-4c1e-81e0-ba4295178e0e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.791627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.792397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.792678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.792953 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.793668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:34.793973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.795614 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.812133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 233/468] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:34.812133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:34.815848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101df55-bea8-4989-8314-ff73bf417dda None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.850730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb07012-4b6d-454d-9efa-1a94cef65cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.851490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07012-4b6d-454d-9efa-1a94cef65cbc None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.851779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07012-4b6d-454d-9efa-1a94cef65cbc None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.852074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07012-4b6d-454d-9efa-1a94cef65cbc None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.852820 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb07012-4b6d-454d-9efa-1a94cef65cbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.854323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb07012-4b6d-454d-9efa-1a94cef65cbc None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:34.874825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 236/469] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:34 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:34.876147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.876436 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.876700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.896532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:34.898083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:34.934699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd080f3f-af31-459c-8d9c-3a0bd0c077ff None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:34.977508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.991112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:34.992051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:34.993869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:34.994473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:34.994572 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:34.995387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:34.997122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:35.015378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 237/470] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:35.015378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:35.041832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 234/471] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:34 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:35.042546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:35.192787 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5557b6-921d-489f-858f-da54c8be3778 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:35.209876 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c98749-1919-4992-a68f-8a02dbaeac74 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:35.243749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0eeb4-6fdd-4fcf-baf8-09c6ab0199b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:35.244869 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eeb4-6fdd-4fcf-baf8-09c6ab0199b4 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.245347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eeb4-6fdd-4fcf-baf8-09c6ab0199b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.245810 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eeb4-6fdd-4fcf-baf8-09c6ab0199b4 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.246818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0eeb4-6fdd-4fcf-baf8-09c6ab0199b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:35.248489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0eeb4-6fdd-4fcf-baf8-09c6ab0199b4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:35.257132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:35.258147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.258505 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.258923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.275341 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 238/472] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:35 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:35.275933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66a0c-8e87-4b30-b595-04dd9d71b963 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.276295 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66a0c-8e87-4b30-b595-04dd9d71b963 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.276580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66a0c-8e87-4b30-b595-04dd9d71b963 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.282329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 239/473] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:35.283814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:35.285316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:35.286409 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.287351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.287645 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.307376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:35.308615 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:35.322517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:35.323773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:35.324960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:35.324960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:35.324960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:35.324960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:35.325521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 235/474] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:35.332113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:35.371213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:35.380564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:35.407080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 240/475] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:35.430719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:35.455951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfbb7-78c2-4c52-8cf4-9091f82a8529 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:35.495121 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:35.495802 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.496088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.496364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.497107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:35.497416 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:35.498871 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:35.511997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 236/476] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:35.518541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:35.560478 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead37d-15dc-4fee-8d39-7a451ca3ed62 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:35.602652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:35.604182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.604816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.605359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.606477 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:35.609386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:35.619493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.sql.core [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:37:35.619493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:37:35.619493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [parameters: {'id': '2da64a52b1c442da977bfdefe38fafed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:37:35.619493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=206999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:37:35.636511 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:35.643356 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa43be-9d6d-495c-96bc-299b62433b9b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application conn.query(q) May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result.read() May 19 14:37:35.644905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return ref.to_dict() May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:37:35.645867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application next(self.gen) May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application yield resource May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application next(self.gen) May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise self.value May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application session.commit() May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:37:35.646959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.session.flush() May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application compat.raise_( May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:37:35.647903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:37:35.649618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application conn.query(q) May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result.read() May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:37:35.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [parameters: {'id': '2da64a52b1c442da977bfdefe38fafed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:35.652902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:37:35.656261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:35.659025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 241/477] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:37:35 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:35.660701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:35.703878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:35.705307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.705605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.705889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.707609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:35.708695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:35.736742 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:35.757755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 237/478] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:35 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:35.820665 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19e97b-e8ea-4f12-a92a-fe83fd80469f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:35.870528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e8bc1-b432-4fcb-8e06-8bdff64df10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:35.871388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e8bc1-b432-4fcb-8e06-8bdff64df10e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:35.871670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e8bc1-b432-4fcb-8e06-8bdff64df10e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:35.871944 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e8bc1-b432-4fcb-8e06-8bdff64df10e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:35.888682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e8bc1-b432-4fcb-8e06-8bdff64df10e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-508e8bc1-b432-4fcb-8e06-8bdff64df10e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:35.897568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:35.898609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:37:35.899572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:35.903352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 242/479] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:35.910972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:36.091107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424db8b-8c93-452c-96e4-92cac6fa4984 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:36.133763 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:36.134437 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:36.134716 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:36.135027 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:36.135783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:36.136088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:36.137474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18859e-f87b-4aa0-8552-99000bdcc836 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:36.147312 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 238/480] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:37.792196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add362-c0dc-4827-b4ff-cffd1697ec93 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:37.793290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add362-c0dc-4827-b4ff-cffd1697ec93 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:37.793801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add362-c0dc-4827-b4ff-cffd1697ec93 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:37.795916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 243/481] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:37.801782 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:37.802724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:37.803253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:37.825830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:37.827466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:37.843760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:37.903287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033a32-e2a3-4a12-8988-80754d926688 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:37.903627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033a32-e2a3-4a12-8988-80754d926688 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:37.903862 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033a32-e2a3-4a12-8988-80754d926688 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:37.906656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 244/482] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:37.911275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12b6-0f69-403f-8a38-6b05012c3493 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:37.911564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12b6-0f69-403f-8a38-6b05012c3493 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:37.911844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12b6-0f69-403f-8a38-6b05012c3493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:37.924184 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 239/483] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:37.943818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-cd3c12b6-0f69-403f-8a38-6b05012c3493 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:37.945046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-cd3c12b6-0f69-403f-8a38-6b05012c3493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:37.950078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.068624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a7e7-f9f8-47b2-b92e-525ab20c36af None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.087514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 245/484] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:38.089025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f225ef-2a84-4f39-9e2c-ce359aca1186 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.089315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f225ef-2a84-4f39-9e2c-ce359aca1186 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.089596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f225ef-2a84-4f39-9e2c-ce359aca1186 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.091155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 246/485] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:38.100115 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.100438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.100713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.113234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.114033 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.114321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.114599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.126409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:38.133691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:38.134777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:38.135832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:38.136740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:38.137423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:38.137507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 240/486] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:38.137507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.151159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.164237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.213430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 247/487] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:38.214450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.248110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1a0f-176d-4a97-b1c1-9c879cedfcb9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.285760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.286570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.286885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.287171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.298517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:38.307109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:38.308091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:38.309002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 241/488] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:38.310269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.326334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e94f4-fa25-42b2-8ace-b324401ca04d None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.369799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.370471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.370754 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.371061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.371821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:38.372235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:38.373932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:38.382617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.385374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 248/489] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:38.386311 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.417379 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.424820 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc8a0-428d-4c2b-adf0-c8b53d92f4d0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.460073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.460875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.461163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.461446 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.472469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:38.480401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:38.481629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:38.482811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:38.487266 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 242/490] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:38.488141 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.511888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8897931-29b9-4351-9400-3aeb8ac7d725 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.549658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.550330 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.550669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.550981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.551882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:38.552192 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:38.553694 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:38.562957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 249/491] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:38.568817 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.592728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41841d8-c9e5-403e-893c-7d75cccbf764 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.617140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.630426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.631412 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.631807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.632192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.644231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:38.645846 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:38.664725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:38.666040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:38.667247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:38.667247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:38.667247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:38.667247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:38.669582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.673751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 243/492] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:38.674802 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.686292 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b95823-1c20-4578-9d10-a250d0b08652 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.725011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.725684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.725966 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.726243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.727125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:38.727435 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:38.729023 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:38.743861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 250/493] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:38.746142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.791508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f8696-aa4f-443c-a194-7169ef3b22f6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.837522 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.838611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.838934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.839217 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.853951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:38.854673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1e7d9-e090-4dd4-a20a-7623c4d5df5a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:38.855374 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:38.874939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:38.877144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:38.879669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:38.879669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:38.879669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:38.879669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:38.879669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 244/494] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:38.879669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.897835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:38.898515 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.899167 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.900267 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:38.900470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:38.901816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66335c-f0f2-4d84-aaf9-7a4c8c824541 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:38.906995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.923332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 251/495] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:38.923332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2a2a-c077-44e8-8453-813492703a53 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:38.923332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2a2a-c077-44e8-8453-813492703a53 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:38.923332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2a2a-c077-44e8-8453-813492703a53 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:38.923332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 252/496] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:38.923852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2a2a-c077-44e8-8453-813492703a53 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:38.940531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:38.995612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788375a-f81a-46b8-a186-4c13e5b099a5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.031429 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.032747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.033036 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.033315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.039297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2a2a-c077-44e8-8453-813492703a53 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.044474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.045928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:39.065322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:39.066306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:39.067648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:39.067648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:39.067648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:39.067648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:39.067648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 245/497] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:39.067948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.084266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.084941 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.085558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.085848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.086749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:39.087091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.088605 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea7f6-7534-4eaa-96ed-9a3538756341 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.100193 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 253/498] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:39.101420 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366326-c359-4288-991b-757d60eb319f None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.101710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366326-c359-4288-991b-757d60eb319f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.101994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366326-c359-4288-991b-757d60eb319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.120443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3e366326-c359-4288-991b-757d60eb319f None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:39.121602 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3e366326-c359-4288-991b-757d60eb319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:39.155690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.176137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10086c-5e0f-4a16-9009-74d44c637611 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.186861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.192751 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 254/499] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:39.193570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366326-c359-4288-991b-757d60eb319f None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.213461 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.214258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.214540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.214832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.226723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.228231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f6cafd6c-825a-49c6-a4fe-c2f6bb78cbf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:39.244639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:39.245869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:39.247112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 246/500] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:39.247772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21760-38e8-470e-9cca-ada6f2d331fb None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.247772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21760-38e8-470e-9cca-ada6f2d331fb None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.247772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21760-38e8-470e-9cca-ada6f2d331fb None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.249162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 247/501] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:39.251761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f21760-38e8-470e-9cca-ada6f2d331fb None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.299161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366326-c359-4288-991b-757d60eb319f None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.332828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.333482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.333764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.334039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.334756 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:39.335093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.336499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.347741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 255/502] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:39.348532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.365724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f21760-38e8-470e-9cca-ada6f2d331fb None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.400930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.401636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.401915 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.402186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.409230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.409489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.411079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.413787 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:39.427190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:39.428326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 248/503] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:39.429334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.453570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07712381-819b-4dfd-a3c7-d9e764d3c2de None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.487593 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff046f-a971-408c-b89d-16cb41cadf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.488382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff046f-a971-408c-b89d-16cb41cadf84 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.488668 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff046f-a971-408c-b89d-16cb41cadf84 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.488949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff046f-a971-408c-b89d-16cb41cadf84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.499176 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff046f-a971-408c-b89d-16cb41cadf84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-66ff046f-a971-408c-b89d-16cb41cadf84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:39.507536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:39.508572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:39.509461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 256/504] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:39.510376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.510376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.510517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.526905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:39.528103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:39.531463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b656d-6176-4796-90e2-9545d7c828c9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.565401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.566066 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.566351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.566628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.567513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:39.567825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.569258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.592920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 257/505] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:39.593758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.606415 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 249/506] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:39.607139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.647871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.668259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.698091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca5c40-f7bc-4edb-a23c-d5dfe231e0c0 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.709471 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd76ff-9a9c-4970-ad1e-ac32687c1726 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.732873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.733664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.733947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.734218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.741902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.743283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.743483 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.743957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.744250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.744533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.745387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:39.745699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.747171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:39.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:39.760497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 258/507] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:39.761503 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.768233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 250/508] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:39.769056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.859526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141243-1b93-4b18-b686-ed671999d94f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.868145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb932b7-d606-4fd7-bb04-54de10079a59 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:39.871275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.884657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:39.896693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.897454 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.897636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.897914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.898666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:39.899008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.900407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:39.902744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:39.903409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:39.903694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:39.903971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:39.908896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 259/509] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:39.909690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:39.971999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:39.973476 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.009336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75cec-8963-4abc-87bc-fa7a4a098a0d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.043138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.043918 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.044198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.044470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.055132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.056582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.071500 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 251/510] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:40.072334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:40.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:40.074210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:40.075219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:40.075219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:40.075219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.075219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:40.075219 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 260/511] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:40.075507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.091772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.102244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.173111 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c6098-034c-4d78-9f93-8bf5afb30c1d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.175176 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544f5e3-a16c-472a-ad48-a727a2c7febb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.206320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.207006 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.207288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.207560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.208383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:40.208489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.208690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.209093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.209378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.209653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.210128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.227572 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 252/512] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:40.228367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.284104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.285607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.302120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.309792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.328533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aec950-69d0-4013-b27f-f11a9fd03472 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.362923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.363707 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.363993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.364274 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.374591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.376608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.385366 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 261/513] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:40.386202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:40.405223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:40.406375 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:40.413743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:40.413743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:40.413743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.413743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:40.413743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 253/514] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:40.413743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.483680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bfd6b-8a6d-4d59-be48-5d79d79261d6 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.507617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.508980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8761-2929-400c-9728-ae52db08c985 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.519138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.519929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.520214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.520499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.530640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.532193 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.534231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.543739 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.544393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.544678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.544954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.545677 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:40.545986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.547405 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:40.549841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:40.550766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:40.551737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:40.551737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:40.551737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.551737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:40.551737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 262/515] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:40.552038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.559341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 254/516] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:40.560006 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.657323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb135c8-7738-4620-aab0-efca7da4fcd2 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.660377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e883-5d58-4ebc-9742-6f728ee9b5d9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.693975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.694766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.695268 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.695544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.695845 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.696492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.696776 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.697049 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.709512 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.711010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:40.727833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:40.729596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:40.731265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:40.731265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:40.731265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:40.731265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:40.733950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 255/517] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:40.734760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.753076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.775614 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.776440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.778113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.835905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a332f2-1a64-404d-b0fb-606b5d49ab44 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.870269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:40.870935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:40.871234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:40.871517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:40.872242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:40.872552 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:40.873933 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:40.878142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 263/518] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:40.879024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.888016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 256/519] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:40.888908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:40.955869 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.978263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac6385-8b2d-4f43-82ab-0dd5e54dd1f7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:40.983368 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:40.987751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196e07-aae9-44a3-a0a3-232672a1785d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.012799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.013462 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.013744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.014028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.014778 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:41.015109 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.016501 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.021310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.021965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.022248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.022517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.023247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.024807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.027893 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 264/520] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:41.028760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.045338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 257/521] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:40 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:37:41.046166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.176225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693e4f5-623b-4f63-bf3e-dee0476ccae7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.186083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f82e-9a85-49c1-9b7e-8b33f54e188e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.214756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.215599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.215886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.216162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.226412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.227116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.227406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.227687 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.228420 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:41.228671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.228783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.230116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.230243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.234020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:41.245164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 265/522] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:41.245941 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:41.259087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:41.260122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:41.261076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:41.261076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:41.261076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:41.261076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:41.261076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 258/523] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:41.261591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.274246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:41.378229 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4594-6524-4fba-b68c-c77ebd72c491 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.382265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b2a02-b902-4a33-a127-f1c4ad058792 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.415389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.416211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.416395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.416538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.416762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.417174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.417461 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.417738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.424513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.424793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.426000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.426243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:41.441764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:41.443051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:37:41.444078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:41.444701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:41.445567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:41.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:41.452801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 266/524] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:41.452801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.452967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 259/525] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:41.452967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.513781 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:41.531981 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:41.560811 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbd9e2-48f9-4553-815d-850643ddbb8a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.568718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e6f9c-321f-419d-8b7e-331aee3755e5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.598150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.598980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.599261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.599535 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.605600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.606299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.606647 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.607219 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.607908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.608052 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.608914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:41.609373 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.610970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.622773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 260/526] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:41.623611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:41.624821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:41.625824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:41.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 267/527] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:41.627307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.734188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94478cb-2359-4388-a7fe-f1b2a95aace9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.748203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f6d8-4d9b-4cb2-8697-86c4fb28adf3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.750331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:41.771823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.772416 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.772695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.772969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.773746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:41.774052 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.775541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.776883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:41.786348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.787057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.787344 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.787620 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.788464 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:41.788777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.790213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.793751 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 268/528] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:41.794853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.808023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 261/529] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:41.808926 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.913082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee876-415c-4327-87ea-51e26465a4d3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.918702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38b64-b49f-4ee2-aab1-16141e2c420a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:41.956707 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.957371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.957657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.957932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.958724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:41.958864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:41.959057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.959609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:41.959894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:41.960172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:41.960495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.967163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:41.968620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:41.983477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 262/530] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:41.983477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:41.983725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:41.984629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 269/531] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:41.986722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:42.025891 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:42.032974 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:42.089764 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff8f1-143e-49d7-8752-aac509785538 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.096701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45a9e1-c46e-4e5f-99d5-db24535b168a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.125237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.126488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.126772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.127074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.127897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=d0d0efbde33d4360ad47bd0c7a545edd) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:42.128206 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.129652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.133194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.133840 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.134129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.134409 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.143055 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 263/532] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/role_assignments?user.id=d0d0efbde33d4360ad47bd0c7a545edd&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:42.143055 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:42.216007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.217619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.262564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:42.287195 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c92529-2a2a-4f82-a516-e16103b57f87 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.298772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:42.329153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.329990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.330371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.330745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.331895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=cca104eef3144e039cf5d7cc0291e6e1) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:42.332666 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.334065 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.347297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 264/533] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:42 2022] GET /identity/v3/role_assignments?user.id=cca104eef3144e039cf5d7cc0291e6e1&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:42.348374 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:42.352398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 270/534] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:42.358119 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:42.479525 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233a3d-f422-4121-924c-cfcf37bcc2eb None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.493483 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50669b8a-cedb-4a84-8252-a2a49b1c4c9c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.551302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.555411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.555696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.555966 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.562669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:42.577195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.578723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.584653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.585332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.585611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.585885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.586695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:42.587031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.588478 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.616926 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 265/535] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:42.619679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:42.620682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:42.622400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:42.622400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:42.622400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:42.622400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:42.622400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 271/536] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:42.626501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:42.630105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:42.675442 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:42.761663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a7c0a-a653-40d5-9913-317b2301ddff None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.814349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.814970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.815256 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.815533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.816372 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=66a6873d208b4d8aa3e7240ec0f94922) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:42.816685 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.818138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.829977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd605d4-9b88-4750-b15c-9d581a01c4e3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:42.832190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 266/537] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:42 2022] GET /identity/v3/role_assignments?user.id=66a6873d208b4d8aa3e7240ec0f94922&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:42.897284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:42.897987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:42.898272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:42.898549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:42.899353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:42.899770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:42.901240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:42.915463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 272/538] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:42.921101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:43.061795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:43.070411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a09e5-2824-4706-9a5d-09669f9c122d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:43.120901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:43.121698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:43.121978 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:43.122249 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:43.132988 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:43.134532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:43.155212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:43.156225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:43.158321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 267/539] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:43.162688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:43.227198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:43.283620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b51a-7970-4c16-b460-b486859591ee None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:43.321691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:43.322763 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:43.323312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:43.323809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:43.324828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:43.325363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:43.327073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8efaf5-9b62-4c4c-b57e-9dac068280bc None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:43.341137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 273/540] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:43.346623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:43.487494 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f8f30-54a3-447a-a2e7-5eca4bc8c4e9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:43.536080 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:43.536752 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:43.537103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:43.537379 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:43.538278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=db27b327147f455c979c2a3105476853) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:43.538594 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:43.540180 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512db96-06f8-41b7-86a2-af90492e6b26 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:43.546529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 268/541] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:43 2022] GET /identity/v3/role_assignments?user.id=db27b327147f455c979c2a3105476853&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:43.582139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f3e2c-90e2-4e8d-a045-bc35612bcbe9 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:43.582772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f3e2c-90e2-4e8d-a045-bc35612bcbe9 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:43.583314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f3e2c-90e2-4e8d-a045-bc35612bcbe9 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:43.585350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 274/542] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:43.591606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:43.592277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:43.592793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:43.613210 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:43.614914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:43.632492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:43.702913 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 269/543] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:43.720756 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f3e2c-90e2-4e8d-a045-bc35612bcbe9 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:43.846279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f3e2c-90e2-4e8d-a045-bc35612bcbe9 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:43.859824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:43.911643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:43.912962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:43.913488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:43.914021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:43.927638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:43.936430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:43.937517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:43.939101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:43.946927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 275/544] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:43.948619 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:44.055996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79272565-f9ff-4e41-9e51-9e18767b65ef None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:44.092239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:44.093293 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:44.093801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:44.094315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:44.095844 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:44.096433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:44.098037 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:44.111164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 270/545] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:44.113872 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:44.247267 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd013089-5232-44bf-bef9-526b4a456031 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:44.296643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:44.297499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:44.298373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:44.298660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:44.313579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:44.315222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:44.332927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:44.333896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:44.334859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:44.334859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:44.334859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:44.334859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:44.338099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 276/546] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:44.340189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:44.356829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:44.447222 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1558e-11f1-41f0-884e-b294afab088b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:44.486320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:44.487024 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:44.487312 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:44.487591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:44.488325 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:44.488630 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:44.490010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:44.506382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 271/547] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:44.507798 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:44.534176 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:44.635677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f79f-ba90-4177-905c-cf6014932669 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:44.688464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:44.689524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:44.689989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:44.690425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:44.700955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:44.702620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:44.717280 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:44.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:37:44.720321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:44.722462 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 277/548] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:44.728185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:44.851393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:44.875383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f4c92-9652-4c1a-b6f1-e7e996d17f86 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:44.912489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:44.913075 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:44.913363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:44.913643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:44.914492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:44.914817 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:44.916466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc13de-5050-4b8d-aa06-a0cac8eddff3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:44.938878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 272/549] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:37:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:44.941774 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.072638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.099510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cc305-8b5b-4a64-b2f5-f52a15f3f690 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.160440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.161387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.161831 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.162266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.199070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f385e-57ba-43ad-86e9-0753ac806cbf None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.199625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f385e-57ba-43ad-86e9-0753ac806cbf None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.199625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f385e-57ba-43ad-86e9-0753ac806cbf None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.201282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 273/550] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:45.207074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307067a5-9836-4521-93b2-955b7e8ae727 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.207371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307067a5-9836-4521-93b2-955b7e8ae727 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.207657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307067a5-9836-4521-93b2-955b7e8ae727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.246486 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-307067a5-9836-4521-93b2-955b7e8ae727 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:45.252276 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-307067a5-9836-4521-93b2-955b7e8ae727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:45.261458 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:45.263186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:45.374178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 274/551] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:45.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98a18e-f3fa-4503-b8c7-83281a9824ba None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.377087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98a18e-f3fa-4503-b8c7-83281a9824ba None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.377544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98a18e-f3fa-4503-b8c7-83281a9824ba None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.379190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 275/552] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:45.384554 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.384850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.385136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.397173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.412945 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:45.415050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:45.429309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 278/553] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:45.431724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.474074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.486450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 276/554] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:37:45.491378 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.546873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf20f-582c-41f1-a615-d2a819fa455d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.587881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.589061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.589607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.590202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.604588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:45.606148 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bb88a-89da-4b97-a295-33365ab1cbe3 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:45.614131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:45.615194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:45.616062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:45.619096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 279/555] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:45.620097 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.643722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.644521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.644968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.645467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.656878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:45.659022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:45.670063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:45.677797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:45.678759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:45.679840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:45.679840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:45.679840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:45.679840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:45.679840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 277/556] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:45.680644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.726357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.744429 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b734b-4a1e-41c6-957f-2671a7198fc5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.786574 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.787806 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.788295 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.788796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.789735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b31b0-5448-4698-a3b0-93be030ae01a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.801310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:45.809889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:45.810907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:45.811961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:45.814986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 280/557] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:45.816020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.825432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.826104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.826390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.826671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.827833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:45.827833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:45.829172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:45.838052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 278/558] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:45.838902 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:45.931303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.936014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c060c4b-4a4a-4f0f-b239-a84b4ccfcbe7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.946876 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e4e7-52e1-4cf1-85f3-c697e342ace1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:45.949674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:45.980730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.981456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.981840 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.982172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.983223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:45.983529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:45.984927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:45.985910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:45.986603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:45.986951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:45.987238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:45.988001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:45.988313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:45.989678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089313-84c2-414a-b6c2-852e0187bb65 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.002389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 281/559] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:46.002389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.002655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 279/560] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:46.002655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079043-8ed5-437f-84ea-c6890d272229 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.002655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079043-8ed5-437f-84ea-c6890d272229 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.002655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079043-8ed5-437f-84ea-c6890d272229 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.002655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 280/561] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:46.003280 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079043-8ed5-437f-84ea-c6890d272229 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.110268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef37cc-0995-4bd0-bcb6-6982bc151b36 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.115373 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079043-8ed5-437f-84ea-c6890d272229 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.144814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.145693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.145979 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.146257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.152109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.152898 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.153181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.153457 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.156528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.158638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.160890 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.162335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:46.176140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:46.177144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:46.178192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0e1a8238-3ea1-4a88-9a55-cc3c2ea1effa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:46.178638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:46.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:46.180528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:46.180528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:46.180528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:46.180528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:46.180758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 281/563] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:46.180837 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 282/563] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:46.180915 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.181866 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8cd2-2ad8-4a9d-822e-68cdfb384810 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.182158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8cd2-2ad8-4a9d-822e-68cdfb384810 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.182651 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8cd2-2ad8-4a9d-822e-68cdfb384810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.198605 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-58fe8cd2-2ad8-4a9d-822e-68cdfb384810 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:46.199885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-58fe8cd2-2ad8-4a9d-822e-68cdfb384810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:46.206798 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.207652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.269273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 283/564] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:46.271096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2dca4-2a43-4b1a-920f-8ad51780c54e None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.271389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2dca4-2a43-4b1a-920f-8ad51780c54e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.271784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2dca4-2a43-4b1a-920f-8ad51780c54e None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.273064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 284/565] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:46.275881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2dca4-2a43-4b1a-920f-8ad51780c54e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.280941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6641-89ea-4a00-8c81-b4b9bcabdc28 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.315702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.316543 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.316830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.317104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.327638 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.329686 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:46.346834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:46.348010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:46.349167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:46.349167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:46.349167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:46.349167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:46.349167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 282/566] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:46.349167 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.386470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2dca4-2a43-4b1a-920f-8ad51780c54e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.419738 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.420381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.420681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.420955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.421675 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:46.421974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.423423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59fdec-806f-4a99-a703-be88effc904b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.433350 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.434639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 285/567] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:46.436155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.436444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.436926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.442172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.455717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:46.456897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:46.460891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3abc8-3fda-4947-aff1-90604840c725 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.493434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.494079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.494366 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.494643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.495495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:46.495807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.497243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.509589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 283/568] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:46.510381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.523820 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 286/569] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:46.524606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.611673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a49c48-a0af-4e06-b665-726f9a82106b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.623349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba882e16-af88-4ba3-aef4-ba758ca55354 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.644363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.645149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.645426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.645699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.652199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.652639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.656689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:46.658082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.658742 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.659058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.659337 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.660059 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:46.660368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.661751 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:46.664856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:46.671477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 284/570] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:46.673196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.682216 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 287/571] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:46.682216 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.770864 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff822c-6f21-403f-a8a8-644fec30b430 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.777301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7bd0c-058e-4baf-bbb6-5c6bcfab9953 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.804249 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.805020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.805300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.805573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] PATH_INFO: `/v3/users/nova` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.811709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:46.812354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:46.812641 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:46.812864 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.812971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:46.813794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=112297493c5747209d968e2ed2d047e0) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:46.814108 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:46.814407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.815588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:46.821132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 288/572] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/role_assignments?user.id=112297493c5747209d968e2ed2d047e0&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:46.821923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:46.828503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:46.830389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 285/573] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:46.831652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:46.901761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.901992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:46.962124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab3470-1471-4e1f-9b0b-529c17d0490a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.963709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79758-505e-41a0-be3d-466d36b8b2ad None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:46.999761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.001350 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.001765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.002322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.002568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.002879 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.003099 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.003225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.004129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:47.004586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.006142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.014215 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:47.018819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 286/574] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:47.018819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:47.022888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:47.023946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 289/575] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:47.029681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.130205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b282-21ab-4b1a-8b16-29d241185f48 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.144354 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e06bd-a32e-4e8b-a358-1acac8039a8b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.154298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.162505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.170513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.171357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.171644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.171927 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.179827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.181211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.181354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.181876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.182158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.182432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.183304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:47.183602 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.185034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:47.196657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:47.197659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 287/576] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:47.198681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.228599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 290/577] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:47.229404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.317961 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a63c-7394-4972-b9e2-5aeb510497e1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.346634 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d74c1-4aae-462e-9a4d-3096c0413d71 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.354227 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.355168 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.355450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.355822 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.367683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.369137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.386924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.387598 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.387883 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.388159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.388909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:47.389218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:47.390189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:47.391390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:47.397045 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:47.397045 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:47.397045 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.397045 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:47.397321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.397413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 288/578] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:47.397413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.406205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 291/579] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:47.407226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.432613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.446591 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.510007 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77131939-d199-45fc-9e99-b4f1b48d5901 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.522708 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272529d-42d6-4665-bebc-a526e8127fa1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.550600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.551561 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.551845 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.552125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.552977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:47.553281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.554722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.559389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.560250 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.560537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.560840 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.573367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.578653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 289/580] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:47.578839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.578943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:47.597191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:47.598257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:47.599223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:47.599223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:47.599223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.599223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:47.599223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 292/581] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:47.599545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.679511 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.690985 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f2b4-6d8e-4393-85ea-31d246332fd6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.695475 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.718081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a54fd-23e7-4d60-94e3-a6367e34e238 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.735610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.736382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.736652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.736923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.737643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:47.737944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.739348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.755964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 290/582] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:47.755964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.759022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.759915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.760268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.760554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.771988 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.773467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:47.791711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:47.792642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:47.793612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:47.793612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:47.793612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.793612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:47.793612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 293/583] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:47.793952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.868863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc1eec-6045-4723-8ed7-923d6c0439fe None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.898160 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83dfa-92f1-4703-94f6-74dfba45b782 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:47.903652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.904509 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.904803 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.905390 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.916768 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.918223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.933445 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:47.934118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:47.934403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:47.934678 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:47.935580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:47.935775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:47.936774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:47.937899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:47.939679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:47.939679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:47.939679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:47.939679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:47.939917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:47.940011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 291/584] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:47.940011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:47.943132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.954769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:47.959026 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 294/585] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:47.959917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.059315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304637-18bd-46f0-a4ff-56f3a21267b2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.066195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38d40-6c55-41c7-a57e-1a822f8b06a7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.095537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.096330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.096613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.096887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.102648 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.103346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.103627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.103922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.104612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:48.104853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.104969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.106279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.106383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.119149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 295/586] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:48.123230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:48.124307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 292/587] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:48.125331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.126831 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.190234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.190839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.232743 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d06dd-13ac-48ce-b07b-2ba9155312a0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.235831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3b971-de3c-4040-9197-9e7d1000f87f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.273496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.274163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.274446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.274719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.275464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:48.275765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.277178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.277430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.277970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.278256 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.278530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.290365 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 296/588] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:48.291837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.291973 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.293460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:48.310745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:48.311767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 293/589] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:48.312791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.409174 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37921-8203-45ce-872e-088de65bf8d0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.421445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f6d8b-0696-45e2-ba5b-86731988d375 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.431242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.444784 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.448062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.448853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.449139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.449627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.457712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.457881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.458445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.458731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.459039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.459245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.459877 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:48.460189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.461612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:48.474628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:48.475703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:37:48.476727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:48.479314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 297/590] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:48.480489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.481774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 294/591] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:48.486297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.593178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64eb84-d4ab-43da-ae58-70145b817d74 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.597392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666fdbf-05d4-4ca5-9825-9874ff117677 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.629665 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.630455 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.630643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.630916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.631709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:48.632021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.633474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.635680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.636480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.636764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.637041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.644585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.650896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 295/592] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:48.651064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.651171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:48.666760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:48.667962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:48.669134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:48.670034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 298/593] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:48.670865 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.707156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.716113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.778759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45ff8-8cfe-4bfd-b968-bff2fc2d2d96 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.782323 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594045c-bc64-48ef-a106-04b9ac2c03a2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.815554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.816346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.816623 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.816897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.817173 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.817836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.818124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.818404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:48.819395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:48.819715 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.821155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.828252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:48.830276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:48.843419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 296/594] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:48.843419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:48.852141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:48.853084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:48.854037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:48.854037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:48.854037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:48.854037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:48.854037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 299/595] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:48.854882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:48.953133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.958131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d07dd-f164-4c02-adf3-6562b8313407 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.961387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:48.971026 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9570-a6b3-40a6-b116-98b0c2525ee2 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:48.997178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:48.998164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:48.998447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:48.998721 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/d0d0efbde33d4360ad47bd0c7a545edd/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.006135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.006847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.007104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.007384 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.008241 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:49.008556 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.010007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.014197 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=d0d0efbde33d4360ad47bd0c7a545edd, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.015666 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.027531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 300/596] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:49.027531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.035321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 297/597] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:48 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/d0d0efbde33d4360ad47bd0c7a545edd/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:49.036146 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.144235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8093569-b74d-4fa0-b791-424610b9f9fb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.157473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4862b-0d35-419c-b98d-85f66992511e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.184890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.185838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.186491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.186770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.197609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.198292 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.198571 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.198882 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.199634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:49.199950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.201355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.201869 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.203910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.218814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 298/598] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:49.218814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-825d5969-e468-479e-930c-34a24e6a11fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:49.228238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:49.229201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:49.230144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:49.230144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:49.230144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:49.230144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:49.230380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:49.230475 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 301/599] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:49.235947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864daf9-1e2d-44b4-8310-ead476ce7e2b None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.236241 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864daf9-1e2d-44b4-8310-ead476ce7e2b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.236530 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864daf9-1e2d-44b4-8310-ead476ce7e2b None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.238191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 302/600] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:49.239946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864daf9-1e2d-44b4-8310-ead476ce7e2b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.244011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:49.345495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924f0f4-7afe-4fb0-8426-1133bbda45e0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.354884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864daf9-1e2d-44b4-8310-ead476ce7e2b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.379937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.380821 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.381121 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.381371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/cca104eef3144e039cf5d7cc0291e6e1/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.395204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.395991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.396275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.396546 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.397018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=cca104eef3144e039cf5d7cc0291e6e1, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.398481 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.404519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.406034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.418813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 299/601] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:49 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/cca104eef3144e039cf5d7cc0291e6e1/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:49.418813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c2df2e58-70b5-4875-a2f0-f71cb5eaf36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:49.430237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:49.431350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:49.432293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 303/602] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:49.433345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.433345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.433515 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.463261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:49.465547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:49.492652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:49.556138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:49.563001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeef0bd-9834-4bf2-babb-f84bba9060e4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.568140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 304/603] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:49.569162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.632169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.632860 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.633146 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.633424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.634284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:49.634592 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.636827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.650377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 300/604] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:49.651609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.709488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a72eb-b9c1-4aa3-b80c-d23012a3895f None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.748481 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.749173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.749522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.749870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.750764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:49.751547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.752724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.765969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 305/605] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:49.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.784532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb3fe-35bb-4fdc-9338-505be03737e9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.810151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:49.835745 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:49.838958 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.840156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.840938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.841728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.857761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:49.869096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:49.870187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:49.871129 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:49.875089 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 301/606] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:49.876929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:49.896335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086f805-1c7d-440b-9d8f-a11917f6f4e9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:49.937943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:49.938823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:49.939321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:49.939603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:49.947464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:49.948986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:49.964359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:49.965336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:49.966294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 306/607] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:49.967290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.005936 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e96fc-bb3f-46b3-bac4-7cf862fb682e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.051021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.052552 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.053301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.053795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/66a6873d208b4d8aa3e7240ec0f94922/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.074017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545af3f-f573-432a-8091-24176aaf25e5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.074826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=66a6873d208b4d8aa3e7240ec0f94922, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.077670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.092721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:50.096105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 302/608] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:49 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/66a6873d208b4d8aa3e7240ec0f94922/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:50.097024 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.121466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.123002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.123519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.124299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.125303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:50.126523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.128775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.130317 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:50.139431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 307/609] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:50.146287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.213281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d0bc0-dc0a-4ceb-b7ff-df4e29fe91a4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.251748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.252455 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.252740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.253029 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.253980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:50.254223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.255706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.261527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aee39-0908-4aa1-84da-949d55b127a9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.285599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 303/610] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:50.291313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.303100 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.304293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.304813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.305301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.318441 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.320351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:50.340360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:50.341410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:50.342353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:50.342353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:50.342353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:50.342353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:50.344829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 308/611] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:50.350639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.383263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:50.457185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:50.473218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40334f2d-c3dd-4efa-aa01-d41016aaabd0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.478337 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c0d28-5691-4093-9ccf-2f977d6a506e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.512442 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.513097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.513351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.513631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/db27b327147f455c979c2a3105476853/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.518770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.519688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.520200 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.520826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.521783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:50.522398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.524021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.529100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=db27b327147f455c979c2a3105476853, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.530592 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.537949 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 309/612] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:50.544876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.551720 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 304/613] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:50 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/db27b327147f455c979c2a3105476853/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:37:50.666422 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:50.689309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c04448-7fd9-48e3-b701-5a28951dd640 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.729314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.730516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.731049 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.731561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.740538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.742399 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:50.759151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:50.760253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:37:50.761245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:50.764169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 310/614] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:50.770668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:50.882038 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be086e81-73ca-4aaa-9a78-aaf780d4952f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:50.918846 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:50.919953 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:50.920444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:50.920989 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:50.922061 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:50.922612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:50.924273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:50.935185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:50.945044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 305/615] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:37:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:50.950758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:51.087715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b389-8467-4089-ae76-e4ad0a18f357 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:51.143519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:51.144706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:51.145205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:51.145719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:51.157261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:51.159590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:51.173947 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:51.185271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:51.186263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:51.187240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:51.187240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:51.187240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:51.187240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:51.190127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 311/616] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:51.195782 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:51.301577 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def31cf-480b-4e2b-ab14-0743b5f3cb9f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:51.338384 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:51.338993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:51.339279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:51.339558 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:51.340288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:51.340595 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:51.341965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:51.354176 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 306/617] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:51.359893 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:51.477746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794430dc-3014-48a3-b687-a160dadfbf63 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:51.527771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:51.528988 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:51.529594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:51.530090 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:51.541773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:51.543616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-9e3db942-2db0-4edf-a68d-ab79ea725b74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:51.560421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:51.561395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:51.562334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:51.565055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 312/618] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:51.570346 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:51.680572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd240-8666-4cf4-a167-994669861272 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:51.680903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd240-8666-4cf4-a167-994669861272 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:51.681135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd240-8666-4cf4-a167-994669861272 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:51.682533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:51.682775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 313/619] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:51.687880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:51.688369 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:51.688533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:51.705229 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:51.706443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:51.768585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:51.775606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 314/620] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:51.794471 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1f53-f2b9-456c-b550-a39f663dd4e1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:51.799692 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:51.842103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:51.843071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:51.843454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:51.843831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:51.845422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:51.845848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:51.847716 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:51.862226 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 307/621] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:51.867664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:51.975213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6b407-0a2e-49dd-866a-3737f9fb1b59 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.012046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.012871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.013156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.013433 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.018386 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d36586-3b17-465a-80c6-429dd6f794e0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.026752 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:52.035772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:52.036755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:52.038073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 315/622] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:52.043277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.053886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:52.097501 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:52.104117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3ef35-c690-4906-b938-2dd099b928e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.105497 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ef35-c690-4906-b938-2dd099b928e2 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.106032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ef35-c690-4906-b938-2dd099b928e2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.106538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ef35-c690-4906-b938-2dd099b928e2 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/112297493c5747209d968e2ed2d047e0/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.123473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3ef35-c690-4906-b938-2dd099b928e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=112297493c5747209d968e2ed2d047e0, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:52.125320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3ef35-c690-4906-b938-2dd099b928e2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:52.140383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 308/623] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:37:51 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/112297493c5747209d968e2ed2d047e0/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:37:52.142782 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd14c-3cbe-45f5-980b-622528de7902 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.143354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd14c-3cbe-45f5-980b-622528de7902 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.143982 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd14c-3cbe-45f5-980b-622528de7902 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.150347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 309/624] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:52.152668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.153201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.153718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.154291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b1510-b9f0-4db9-a13f-8d4f31fc9fd8 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.173590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:52.175359 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:52.200732 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.201470 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.201691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.202048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.202714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:52.203042 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:52.204993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:52.226955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 316/625] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:52.235970 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.276860 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 310/626] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:52.295160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.404972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5953-ccba-46ec-aad8-94650f2e2855 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.418399 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:52.427989 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:52.434181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32673-af12-4964-828c-371ba2292ad9 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.443245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.444048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.444331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.444603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.459155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:52.460626 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:52.478293 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088933-7872-4c46-8942-2621903f7749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:52.478914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:52.479894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:52.481248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:52.481248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:52.481248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:52.481248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:52.481248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 317/627] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:52.482776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088933-7872-4c46-8942-2621903f7749 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.483313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088933-7872-4c46-8942-2621903f7749 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.483804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088933-7872-4c46-8942-2621903f7749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.486594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.496913 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46088933-7872-4c46-8942-2621903f7749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-46088933-7872-4c46-8942-2621903f7749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:52.513056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:52.514105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:52.515178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:52.522898 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 311/628] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:52.524899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088933-7872-4c46-8942-2621903f7749 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.594336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b627f-77be-49cf-a5fc-23ccd4ac39b1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.630552 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.631103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.631383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.631653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.632373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:52.632679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:52.634070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:52.642163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088933-7872-4c46-8942-2621903f7749 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.651093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 318/629] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:52.652208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.683236 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:52.727520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.728198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.728545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.728759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.729523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:52.729828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:52.731258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:52.750327 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 312/630] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:52.758082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a9dab-4180-4e73-a307-f1ff6bb5f704 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.760306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.791157 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:52.822600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.823510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.823795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.824067 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:52.840080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:52.841560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:52.867640 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:52.868727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:52.870351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 319/631] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:52.874495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:52.924998 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec24fff-0a2a-46c3-9283-241a941e138c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:52.979213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:52.981272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:52.982836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:52.983528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.003992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.006400 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:53.041589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:53.042613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:53.043581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:53.043581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:53.043581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:53.043581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:53.054234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 313/632] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:37:53.057441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.072472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.103835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbffa94-cb3d-4da4-84cd-1e3aa8a29a37 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.159135 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.161984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.162672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.162987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.163268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.164117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:53.164425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.166003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.207607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 320/633] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:37:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:53.211396 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25f112-e952-40a3-8157-b877c4304eb4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.214121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.298203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.298904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.299195 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.299475 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.300223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:53.300530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.301942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f5d2-79b3-4acd-98c5-a49853a4d4d4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.322558 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 314/634] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:53.324051 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4cff-b269-40b3-aece-3579498c217f None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.324409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4cff-b269-40b3-aece-3579498c217f None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.324613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4cff-b269-40b3-aece-3579498c217f None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.326634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 315/635] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:53.328165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4cff-b269-40b3-aece-3579498c217f None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.390592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1bab-3966-4b41-b3f5-4a6557b566af None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.433445 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df3eb8-ff8c-4885-bd13-3cda1c4cbd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.434198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3eb8-ff8c-4885-bd13-3cda1c4cbd88 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.434490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3eb8-ff8c-4885-bd13-3cda1c4cbd88 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.435059 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3eb8-ff8c-4885-bd13-3cda1c4cbd88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.452387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.458042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4cff-b269-40b3-aece-3579498c217f None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.489881 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.496222 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.497014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.497328 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.497565 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.505585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.507059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.511839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df3eb8-ff8c-4885-bd13-3cda1c4cbd88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.513433 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df3eb8-ff8c-4885-bd13-3cda1c4cbd88 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-9c843880-bec5-4fc3-b84b-dc42be1b31ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:53.521738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:53.522724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:37:53.524253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:53.527387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 316/636] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:53.528586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.528875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.529153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.545806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:53.547124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:53.626439 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 321/637] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:37:53.628105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170586-d954-4972-aca7-3f5f3b44a854 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.628398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170586-d954-4972-aca7-3f5f3b44a854 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.628670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170586-d954-4972-aca7-3f5f3b44a854 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.634983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 317/638] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:53.635164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 322/639] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:53.635164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170586-d954-4972-aca7-3f5f3b44a854 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.635329 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.686067 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.750186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170586-d954-4972-aca7-3f5f3b44a854 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.753795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed017f-e145-4fb4-8e8d-0bb93342ba97 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.778000 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.787803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.788688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.789048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.789391 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.793203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.793943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.794301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.794653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.795582 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:53.795895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.797322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861761-8aad-44ce-82ae-aa16e59dc3e7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.800308 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:53.801766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:53.820531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 318/640] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:53.820704 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.821160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.821160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:53.821619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:53.822498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:53.823854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:53.823854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:53.823854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:53.823854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:53.823854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 323/641] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:53.823854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.842345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:53.843857 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:53.912581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 319/642] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:53.913507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:53.942522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:53.950488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89938bae-c05b-49eb-acd6-bca44d34300f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:53.986968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:53.988104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:53.988564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:53.988998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.007590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:54.015712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:54.017290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:54.018185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:54.021516 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceee2bf-f3bf-40d9-b167-3ef2625eb37b None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.022455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 324/643] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:54.023114 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.032044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.060502 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.061149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.061433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.061708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.131621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed8fe5-3546-4e81-927e-6872bbf3c90d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.134932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.136417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.167955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.168861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.169331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.169764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.170647 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:54.171150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.173118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.189975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 325/644] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:54.189975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.205313 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.251332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 320/645] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:54.252221 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.262964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.301889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829715d9-19f7-46e4-8f16-317e2ae820fe None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.338148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.339335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.339838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.340351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.351526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:54.359662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:54.361206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:54.362113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 326/646] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:54.363667 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.370097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ec95f-908c-4d1d-a157-45575bb179c1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.406389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.407128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.407425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.407701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.408459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:54.408771 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.410160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.419039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 321/647] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:54.424759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.443696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.471366 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687342b-ede8-419d-b082-de16cd17e85c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.501943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.506980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.507847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.508200 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.508544 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.515428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.516984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:54.531367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:54.533068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:54.534076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 327/648] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:54.534655 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.543001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442d7f-6553-4eeb-90a0-2afce4ea38ed None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.581663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.582552 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.582878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.583137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.595398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.596746 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:54.615041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:54.616018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:54.617008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:54.617008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:54.617008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:54.617008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:54.617008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 322/649] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:54.617008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.652315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab456-5c54-47e1-b0dc-34dda05eba77 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.687994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.688843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.689239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.689588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.690411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:54.690806 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.692210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.693844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.706179 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 328/650] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:54.706179 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.733451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb03a7-51ab-4242-a13a-e3f25fbfc65b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.757430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.773767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.774646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.774969 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.775239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.786303 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.787783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:54.805113 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:54.806237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:54.807393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:54.807393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:54.807393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:54.807393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:54.807393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 323/651] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:54.807393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.809878 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd2e3b-279e-40ed-896c-a6798258cabe None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:54.842539 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:54.843171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:54.843457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:54.843727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:54.845039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:54.845352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:54.846812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:54.859056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 329/652] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:54.859858 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:54.919600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:54.965359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d59a36-e1e8-44d5-abc6-c491fda253ab None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.001141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.001933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.002213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.002484 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.012791 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.014260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b9938f5f-b179-4e7d-8ade-b965e7747a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:55.035607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:55.036724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:55.037674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:55.037674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:55.037674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:55.037674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:55.037674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 330/653] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:55.038894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc598a76-8a5f-413d-b9a7-8898c9b60f69 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.039179 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc598a76-8a5f-413d-b9a7-8898c9b60f69 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.039468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc598a76-8a5f-413d-b9a7-8898c9b60f69 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.041516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 331/654] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:55.042233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc598a76-8a5f-413d-b9a7-8898c9b60f69 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.044745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f0638-f7e6-4bc1-9d21-b16f945d186f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.077858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.078519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.079346 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.079615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.080333 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:55.080634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.082013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.093079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 324/655] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:55.094162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.127332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.148159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc598a76-8a5f-413d-b9a7-8898c9b60f69 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.157713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.182318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.183004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.183284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.183562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.184272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:55.184575 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.185948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.191956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be359224-8289-42f6-91ad-21258d540b8c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.197912 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 332/656] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:55.198704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.227308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.227958 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.228242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.228519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.229351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=d0d0efbde33d4360ad47bd0c7a545edd) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:55.229660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.231124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb446-f182-4881-8188-236f8e9d2232 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.237708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 325/657] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/role_assignments?user.id=d0d0efbde33d4360ad47bd0c7a545edd&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:55.238907 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.239198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.239479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.264382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:55.268139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:55.320557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3741c6-5aad-4e1e-a2ea-27f209ddab86 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.355120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 326/658] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:55.355120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.375120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.376716 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.377006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.377283 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.378031 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:55.378335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.380472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.388911 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.395096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 333/659] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:55.400462 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.434212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.472468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6ada-e6a2-4991-a788-bd21ea5cf2c8 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.513988 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.514819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.515095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.515370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.522905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb980-8286-4481-b3c0-e2dc49a7329d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.523248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.524707 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:55.538674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:55.539699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:55.540674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 327/660] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:55.541211 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.564011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.564813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.565091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.565363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.573328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.574781 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:55.590152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:55.591432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:55.592526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 334/661] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:55.593150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.639826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.654291 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc779c-2e4e-4afd-9d12-d4dff6351bb5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.691112 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.692116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.693056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.693174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.693521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.705113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27baa2-1c8d-4365-9376-48516044a4c7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.705281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:55.712799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:55.713776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 328/662] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:55.720161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.750977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.751874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.752271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.752546 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.760182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.761864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:55.778382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:55.779570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:55.780584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 335/663] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:55.781203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.833317 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa7eec-da6a-401f-87ef-efd4c56059bc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.873745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.874410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.874692 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.875011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.875840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:55.876149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.877569 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.890052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 329/664] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:55.890823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.892673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc844b7-3155-400f-a202-0d279ee5990f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:55.901949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.933087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:55.933758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:55.934044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:55.934322 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:55.935194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:55.935505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:55.936990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:55.960517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 336/665] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:55.960517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:55.970155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:55.998487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96129-9f41-4eae-9cf4-ed63179ff437 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.035722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.036484 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.036769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.037046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.037790 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:56.038107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.039513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.047957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 330/666] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:56.048781 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.076880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb047a5-8942-4b32-bb82-4cd427d60f57 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.113194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.114182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.114709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.115258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.116338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:56.116825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.118315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.119418 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.137899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 337/667] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:37:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:56.138759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.157694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1669e5-41ff-4a1c-994a-2d822d0c7b63 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.192898 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.193599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.193879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.194262 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.195138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=cca104eef3144e039cf5d7cc0291e6e1) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:56.195440 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.197043 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.210822 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.211068 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 331/668] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/role_assignments?user.id=cca104eef3144e039cf5d7cc0291e6e1&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:56.211068 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.255811 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a186b-30b2-4539-ba61-08f85c1b754c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.305647 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.306438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.306826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.307204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.345399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5c09b-864c-4f41-88e5-cda937a4ebdd None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.386194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.387255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.387619 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.387975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.390423 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.392965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.395352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.401578 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.403202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:56.424181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:56.425199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:56.426150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:56.426150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:56.426150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:56.426150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:56.426150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 332/669] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:56.426559 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.475247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.536687 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 338/670] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:56.537898 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.558353 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04d8a-8ad2-4831-85d7-c5acf47f8b58 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.600827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.601595 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.601958 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.602307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.663372 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.682464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52333906-a09f-4ecd-b7e2-54c873043172 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.686518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.689946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.730074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.730940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.731332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.731713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.732819 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:56.733226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.734721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.748060 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 339/671] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:56.749057 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.778139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.818429 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 333/672] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:56.819388 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.866579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5319f-4961-443e-9263-c99666b5d15d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.902436 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.903431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.903726 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.904007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.918068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.919959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:56.925514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:56.942333 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff086c98-61c7-4f39-970c-8de805a879d1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:56.943140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:56.944081 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:56.945013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:56.945013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:56.945013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:56.945013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:56.950016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 340/673] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:56.950916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:56.984338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:56.985694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:56.985980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:56.986259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:56.994150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:56.995625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:57.010641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:57.011703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:37:57.012723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:57.016685 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 334/674] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:57.017551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.043397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.059298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde194-5e41-4253-93a0-328ee2e945a7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.096204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.099103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.099410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.099701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.117605 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.119128 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.133485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa403ed-d3eb-49d3-89bb-0d2ccbfb37fd None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:57.137299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:57.138851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:57.141020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:57.141020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:57.141020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:57.141020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:57.141020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 341/675] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:57.141020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.175880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.176689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.176984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.177266 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.178050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:57.178368 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.179781 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.192901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 335/676] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:57.193744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.202731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.253856 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1059-5058-4de5-84c9-075d4b634a59 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.301393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.302201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.302593 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.303011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.303970 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:57.304384 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.305965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.307935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdcde8-e207-4570-8a12-9254e9200e54 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.323188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.326834 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 342/677] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:57.327350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.350775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.351489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.351777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.352059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.352903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:57.353107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.354473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.367274 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 336/678] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:57.372501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.444563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.449538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36667-6c58-4201-befa-a77c5a115fe0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.482171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e4c9-6200-4cff-9949-2772b8410693 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.495062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.496327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.496847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.497336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.506064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.507831 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.523635 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:57.523953 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:57.524942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:57.525874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:57.526340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.526340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.526340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.533311 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 343/679] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:57.534604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.596851 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.598318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.599579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.647230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77ff5-8103-44b0-93d8-e42913d4bbf5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.673655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.683975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.685131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.685610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.686105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.694088 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.695863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.711124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 337/680] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:37:57.711970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d0e0ae69-77f5-43a1-bda1-116ede407efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:57.713430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:57.714346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:57.715357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:57.716482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 344/681] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:57.717974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e3727-4ce3-4cbe-99c3-90e8e3f4d230 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.717974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e3727-4ce3-4cbe-99c3-90e8e3f4d230 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.718164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e3727-4ce3-4cbe-99c3-90e8e3f4d230 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.719743 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 345/682] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:57.720451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e3727-4ce3-4cbe-99c3-90e8e3f4d230 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.824295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1d64f-5de9-4c46-86ff-035ce7cc30c3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.836051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e3727-4ce3-4cbe-99c3-90e8e3f4d230 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:57.844347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.861325 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.861994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.862347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.862561 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.863387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:57.863701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.865133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.873917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:57.874710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.875034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.875317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.882653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 338/683] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:57.883324 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:57.886746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:57.888243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-921fd7eb-a169-4c99-b754-061c159711f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:57.906400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:57.907529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:57.908480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:57.908480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:57.908480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:57.908480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:57.908480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 346/684] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:57.909190 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:57.909190 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:57.909360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:57.916153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:57.926276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:57.927517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:57.997910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 347/685] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:57.999296 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.000355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b3b2-2d39-468f-92c0-201e4cce422b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.039379 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.040045 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.040331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.040605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.041394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:58.041710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.043179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.057967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 339/686] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:58.059673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.106199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:58.120828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e23d-a8e7-43fa-a67b-31a5898a79a0 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.151004 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:58.159007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.160086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.160469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.160752 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.161580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=db27b327147f455c979c2a3105476853) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:58.161967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.163364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.167166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24223e-fb8e-4c41-8984-7e14dc99feb8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.170075 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 348/687] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:57 2022] GET /identity/v3/role_assignments?user.id=db27b327147f455c979c2a3105476853&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:58.170364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.228472 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.230034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.230559 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.231087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.232050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:58.233570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.236133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.257619 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 340/688] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:58.258907 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.292951 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210b5f-819c-4a3d-8aee-324df97b1e80 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.331353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.331987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.332271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.332542 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.345224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:37:58.353496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:58.354599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:37:58.355541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:58.360557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 349/689] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:58.361633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.377600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:58.394053 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8199-1a4f-41cf-82dd-ff8190cef3d8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.438645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.439351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.439629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.439900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.440732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=66a6873d208b4d8aa3e7240ec0f94922) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:58.441035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.442468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.448825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 341/690] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/role_assignments?user.id=66a6873d208b4d8aa3e7240ec0f94922&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:58.449828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.464643 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:58.499094 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0bc7-18c8-4b62-abe6-568a797b555b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.590025 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23aa4-9011-4f22-b660-32236067540b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.604993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.605822 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.606106 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.606392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.615372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.617107 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:37:58.632950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:58.633993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:58.634991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 350/691] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:58.643871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.684155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.684840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.685130 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.685410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.686177 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:58.686486 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.687908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.711081 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 342/692] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:58.712510 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.755245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:58.795651 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915ce93-4ad7-4ebe-8566-f52c5afce715 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.804840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:58.838852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.839533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.839817 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.840147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.840892 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:58.841200 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.842670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa680-44fb-4cd7-8f19-a57e6e187d78 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.847896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d367e-1213-4be5-9329-01f3b10643a3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:58.864668 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 351/693] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:58.871305 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1864-6a1a-44e5-ae4d-54453b203e0b None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.872005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1864-6a1a-44e5-ae4d-54453b203e0b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.872508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1864-6a1a-44e5-ae4d-54453b203e0b None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.874588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 352/694] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:37:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:37:58.875707 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e1864-6a1a-44e5-ae4d-54453b203e0b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:58.896333 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:58.897404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.897691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.897972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.914176 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:58.915747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-4f0587a2-2b32-49bf-b056-2f76b64d2986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:58.938503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:58.939567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:58.940570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:58.940570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:58.940570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:58.940570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:58.940570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 343/695] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:58.941445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:58.941734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:58.942011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:58.963975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:37:58.965596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:37:58.993862 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e1864-6a1a-44e5-ae4d-54453b203e0b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.026422 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:59.034083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.035142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.036237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.036733 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.038072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=112297493c5747209d968e2ed2d047e0) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:59.038929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.041330 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.059040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 344/697] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:37:59.059776 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 353/697] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:37:58 2022] GET /identity/v3/role_assignments?user.id=112297493c5747209d968e2ed2d047e0&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:59.060169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.126227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.146126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:59.201326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe30b4-b4c3-4bfb-abb8-10ea2bf0a641 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.243467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.244143 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.244427 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.244718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.245509 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:59.245830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.247265 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.261361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 345/698] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:59.272306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.337782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5f92-9f01-4e3b-9149-401c02fa847d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.374173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.375016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.375311 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.376218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.382034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78bcb-0a97-490e-b8d7-4e3bc8fd925b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.389166 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.391164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.398257 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:37:59.413793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:59.414801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:59.415794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:37:59.415794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:37:59.415794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:37:59.415794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:37:59.418952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 354/699] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:59.423159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.432098 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.432950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.433242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.433517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.445358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.446986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:37:59.462731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:37:59.463873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:37:59.464879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 346/700] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:37:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:37:59.476136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.483659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:59.574817 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477ac79-703f-480c-9ef9-3140eec50115 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.614892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b8fa-9cb7-4dfe-b85f-d769a8957ef0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.622820 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.623564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.624417 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.624709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.625451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:59.626333 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.628349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.649952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 355/701] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:37:59.652732 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.659666 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.660625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.661176 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.661663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.662728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:37:59.663282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.665035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.699991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 347/702] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:37:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:37:59.706997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:37:59.739231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:59.834092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46d4cc-298e-4d65-84a4-934a9dfc5188 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.862771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681388dc-f860-4df6-8c47-c79f5cdca07e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:37:59.880926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:37:59.903359 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.903939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.904225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.904506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.930024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:37:59.930776 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:37:59.931084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:37:59.931373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:37:59.932094 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:37:59.933552 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:37:59.974921 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 356/703] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:37:59 2022] POST /identity/v3/users => generated 254 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:38:00.031252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:00.033437 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:00.088786 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:00.205911 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 348/704] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:38:00.213389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:00.342986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9ba18-2a72-468c-854b-8d4583ac684c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:00.379177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:00.379976 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:00.380256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:00.380528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:00.392607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:00.394083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:00.412948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:00.413959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:00.415343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:00.415343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:00.415343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:00.415343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:00.415343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 357/705] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:00.420081 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:00.547279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad87a-aa11-4a01-9d2d-038c34f53613 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:00.596655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:00.603816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:00.604493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:00.604782 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:00.605059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:00.605793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:00.606103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:00.607897 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:00.623074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 349/706] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:00.628674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:00.662968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:00.810704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216ab8-f3dd-4f47-ae6a-d15d05a5a5ca None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:00.862165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:00.863021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:00.863312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:00.863592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:00.874229 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:00.876327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-cbe76441-2f58-4f90-a879-ee176ca48086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:00.901852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:00.902895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:00.904487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 358/707] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:00.908838 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.070018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33e6c-335a-4060-a8f9-6c61597fb0a0 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.070224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33e6c-335a-4060-a8f9-6c61597fb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.070491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33e6c-335a-4060-a8f9-6c61597fb0a0 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.072178 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 359/708] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:01.077357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4f0d1-9ea0-4a99-bb0f-aaf33f0dca54 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:01.078432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442fc1-6845-4abb-a9ad-53d6802c8126 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.078761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442fc1-6845-4abb-a9ad-53d6802c8126 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.079069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442fc1-6845-4abb-a9ad-53d6802c8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.111739 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-51442fc1-6845-4abb-a9ad-53d6802c8126 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:01.113066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-51442fc1-6845-4abb-a9ad-53d6802c8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:01.115826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:01.117086 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.117590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.118277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.119382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:01.119917 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:01.121876 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:01.136032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 350/709] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:01.141426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.242349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:01.252948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 360/710] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:38:01.255485 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cade56-7c74-4cfc-b9c1-ef13ca9ff923 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.256013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cade56-7c74-4cfc-b9c1-ef13ca9ff923 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.256502 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cade56-7c74-4cfc-b9c1-ef13ca9ff923 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.259017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 361/711] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:01.263975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.264511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.265209 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.291957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:01.302130 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3fa04-4957-4442-a398-31604f1ec3f1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:01.341918 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:01.342562 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.342915 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.343199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.344061 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=d0d0efbde33d4360ad47bd0c7a545edd) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:01.344919 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:01.346425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:01.353753 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 351/712] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:01 2022] GET /identity/v3/role_assignments?user.id=d0d0efbde33d4360ad47bd0c7a545edd&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:01.354658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.439225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:01.440870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:01.476858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c9d0-9de8-4a9f-9219-683c86464bd9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:01.509130 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:01.515825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:01.517459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.517854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.518248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.519080 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:01.520570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:01.522238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 362/713] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:01.559623 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:01.560928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:01.562040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 352/714] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:01 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:01.568600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.571573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.716499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6d82d-0b9e-4738-9b4b-bc114eb8d8c8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:01.761225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:01.762191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.762476 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.762754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.763743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:01.765553 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:01.769812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9b37d-4ff1-4cfb-891f-4421da84e4fe None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:01.780850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:01.782492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:01.785862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 353/715] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:38:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:01.792858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.844146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:01.845407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.845694 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.845974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.846703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] RBAC: Adding query filter params (name=network) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:01.847038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:01.848477 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:01.854210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:01.862682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 363/716] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:01.869346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:01.895160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:01.958895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed243c-214e-4674-a005-574d1c47af17 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:01.993450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:01.994031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:01.994316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:01.994594 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:01.995356 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:01.995662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:01.997040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7998c-b6fe-417c-8807-cce44429a036 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:01.998240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b06b0-7e3e-485b-9edc-a4e1cce27b07 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:02.002401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 354/717] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:38:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:02.003730 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edfdbb-b515-480e-b83c-dbfd9cfe8964 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.003983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edfdbb-b515-480e-b83c-dbfd9cfe8964 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.004260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edfdbb-b515-480e-b83c-dbfd9cfe8964 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.009646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 355/718] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:02.010459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edfdbb-b515-480e-b83c-dbfd9cfe8964 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:02.043461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:02.044133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.044472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.044751 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.045516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] RBAC: Adding query filter params (type=network) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:02.045835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:02.047269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850f7d-f9bf-435f-8dd4-cc024d98044c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:02.058927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 364/719] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:02.060933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.060933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.061152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.097375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:02.098609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:02.129494 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edfdbb-b515-480e-b83c-dbfd9cfe8964 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:02.141732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:02.180395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:02.181563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.182062 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.182557 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.183677 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:02.184215 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:02.185862 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:02.191339 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:02.202896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 365/720] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:38:02.203513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 356/721] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:38:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:02.243349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:02.365440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5376ae8-db6b-443b-8067-b1f763f0b07e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:02.403876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:02.404698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.404984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.405260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.417903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:02.427342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:02.428510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:02.429404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:02.432609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 366/722] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:02.438946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:02.602602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6ccf1-dba1-4e54-a060-0c9d8c8b15d5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:02.643850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:02.644524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.644810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.645088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.645843 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:02.646151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:02.647555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:02.656590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 357/723] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:02.662546 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:02.780795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:02.840285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c165-2ed5-4d2e-a141-3bd3e5161246 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:02.882388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:02.883122 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:02.883403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:02.883677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:02.900097 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:02.901569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:02.930287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:02.931345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:02.932304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:02.932304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:02.932304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:02.932304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:02.932304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 367/724] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:02.938946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:02.990554 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:03.092880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2219d-4a35-440a-b655-3316fcfad321 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:03.143074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:03.143708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.143940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.144210 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:03.144944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:03.145252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:03.146633 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a70f9-a13e-4641-a34d-f54dcab7b26b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:03.164140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 358/725] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:03.169290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:03.335444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95a97e-2123-41ff-9897-3c2de4f34608 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:03.342994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:03.360824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b451e8-b35c-4008-9bbf-f08462f94522 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.361459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b451e8-b35c-4008-9bbf-f08462f94522 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.361949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b451e8-b35c-4008-9bbf-f08462f94522 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:03.367865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 359/726] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:03.373158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:03.373951 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.374230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.374500 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:03.374706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36497700-a081-4671-ad42-17edda408f04 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.375450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36497700-a081-4671-ad42-17edda408f04 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.375954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36497700-a081-4671-ad42-17edda408f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:03.382403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:03.383887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:03.400494 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:03.401513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:03.402549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 368/727] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:03.411054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:03.414377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-36497700-a081-4671-ad42-17edda408f04 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:03.415839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-36497700-a081-4671-ad42-17edda408f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:03.534748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 360/728] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:38:03.560847 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36497700-a081-4671-ad42-17edda408f04 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:03.599579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3d6b-adfe-4680-8498-8607936c1db3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:03.605075 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:03.668555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:03.669146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.669427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.669804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:03.670763 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:03.671098 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:03.672701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:03.710760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 369/729] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:38:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:03.716158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:03.742976 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36497700-a081-4671-ad42-17edda408f04 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:03.767151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:03.817518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:03.818617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.819076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.819608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:03.840347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:03.854806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:03.855977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:38:03.857079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:03.859653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 361/730] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:03.862523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee445857-fe72-4c3e-ba45-39db8e2db447 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:03.868461 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:03.905918 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa47ee8-24bc-437e-895d-ea4ee595389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:03.906870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa47ee8-24bc-437e-895d-ea4ee595389a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:03.907268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa47ee8-24bc-437e-895d-ea4ee595389a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:03.907656 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa47ee8-24bc-437e-895d-ea4ee595389a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.015091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.033286 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeaeac-eecd-43a6-986f-0f83f58a6d68 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.048651 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa47ee8-24bc-437e-895d-ea4ee595389a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.050133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa47ee8-24bc-437e-895d-ea4ee595389a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.071452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.072282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.072673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.073054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.073920 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:04.074334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.075839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.085331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 362/731] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:04.090818 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.139863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.197711 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea9b19-4492-4e58-badb-1728dae87893 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.229164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 370/732] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:38:04.230611 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b51e9-4d7d-4e5c-9e5a-963c0659dfbc None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.230936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b51e9-4d7d-4e5c-9e5a-963c0659dfbc None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.231220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b51e9-4d7d-4e5c-9e5a-963c0659dfbc None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.232873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.233950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.234244 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.234524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.237435 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 371/733] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:04.238225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b51e9-4d7d-4e5c-9e5a-963c0659dfbc None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.247054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.248526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.255979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-11048fb2-36d8-4fca-9800-21c6bdade115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:04.268644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:04.269628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:04.271125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:04.271125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:04.271125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:04.271125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:04.271125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 363/734] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:04.276004 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.276297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.276682 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.294305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:04.295560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:04.349441 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b51e9-4d7d-4e5c-9e5a-963c0659dfbc None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.368859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 364/735] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:38:04.369732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.391302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.406266 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.407823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.408227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.408660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.425065 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.426706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:04.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:04.446696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:04.447860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:04.447860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:04.447860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:04.447860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:04.449567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 372/736] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:04.450775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.477338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab99111-3839-4aff-8027-8768c89cb574 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.506104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.515083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.516002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.516467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.517736 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.518709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:04.519214 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.520767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.538326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 365/737] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:04.539543 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.560414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eec6c-5853-41af-b47e-aa1c25c704a8 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.596091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.597189 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.597423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.597807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.609188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:04.622812 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:04.623844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:04.624744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 373/738] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:04.625534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.654625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854528e-a618-4c24-b35e-0809c6fe0af4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.666768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.697729 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.698751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.699230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.699655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.700543 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:04.701015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.702656 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.717581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 366/739] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:04.718937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.744404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f61ed-aae3-4dbd-83a9-fcd7f5a8295a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.776825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.781610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.784244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.784692 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.784806 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.793592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.795015 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:04.811138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:04.812207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:04.813255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 374/740] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:04.813899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.837018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421d3f-fe08-42a4-94a3-6a77351ac11b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.874289 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.874987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.875320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.875568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.876318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:04.876616 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.877977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.886495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 367/741] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:04.893101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.919178 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:04.925937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74d07-612e-47b7-8ed2-c38fc62c7df0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:04.960229 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:04.961016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.961299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.961574 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.970214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:04.971709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-3abc26a1-e9e5-4545-8b26-912c131878c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:04.986147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:04.987364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:04.988302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 375/742] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:04.990297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b54a-1c87-4dc4-9a50-d77ea4b16e91 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:04.990597 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b54a-1c87-4dc4-9a50-d77ea4b16e91 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:04.990913 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b54a-1c87-4dc4-9a50-d77ea4b16e91 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:04.992481 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 376/743] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:04.993200 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b54a-1c87-4dc4-9a50-d77ea4b16e91 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:04.997541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cf0-bcbf-4b71-bb36-347925260d78 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.008399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.033680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.034250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.034541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.034845 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.035692 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:05.036000 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.037444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c10127-7abe-4515-a5cf-b895029c5001 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.054413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 368/744] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:05.055733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f06b9-5e38-41c2-bfcb-5d732e1c45dd None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.056010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f06b9-5e38-41c2-bfcb-5d732e1c45dd None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.056294 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f06b9-5e38-41c2-bfcb-5d732e1c45dd None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.057686 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 369/745] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:05.058211 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f06b9-5e38-41c2-bfcb-5d732e1c45dd None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.099614 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b54a-1c87-4dc4-9a50-d77ea4b16e91 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.133761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.134551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.134863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.135144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.150529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.154690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.166551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f06b9-5e38-41c2-bfcb-5d732e1c45dd None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a347365b-1940-4e87-a6d3-3d2d43d3c350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:05.176224 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:05.177386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:05.178398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:05.178398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:05.178398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:05.178398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:05.178662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 377/746] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:05.179867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f47e82-643c-405f-944c-3e012d610a95 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.180155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f47e82-643c-405f-944c-3e012d610a95 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.180440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f47e82-643c-405f-944c-3e012d610a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.198810 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-64f47e82-643c-405f-944c-3e012d610a95 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:05.200171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-64f47e82-643c-405f-944c-3e012d610a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:05.205528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.206010 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.206221 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.206470 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.206883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.207865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:05.208169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.209600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.225360 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 370/747] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:05.226523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.257144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.284821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 378/748] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:38:05.286312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.286683 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.287069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.305565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:05.306951 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:05.341583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b57c9-1375-433a-abcc-9209012b712d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.381302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 379/749] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:38:05.382171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.382430 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.383120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.383402 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.383402 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.450064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.457596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.459100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.487726 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410213d-678e-4e46-98bd-421481f3b483 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.488055 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.523240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.524349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.524851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.525355 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.526625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:05.526968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.528358 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.540397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 380/750] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:05.541136 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.566573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 371/751] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:38:05.567532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.648560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e234-6ecd-4595-bbc7-2a2c5e313148 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.671316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c497f72-a312-41ba-8bf8-d915695a02bc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.680039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.688357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.689011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.689293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.689566 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.690394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=112297493c5747209d968e2ed2d047e0) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:05.690702 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.692188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.697706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:05.710729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 381/752] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:05 2022] GET /identity/v3/role_assignments?user.id=112297493c5747209d968e2ed2d047e0&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:05.710729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.711069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.711069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.711069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.711069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.711456 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.711456 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.734859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 372/753] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:05 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:05.734859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.869049 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443b02-00e1-4630-aaa0-a9fc0a5c5643 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.915800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.916517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.916795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.917062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:05.917794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:05.919220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:05.926728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9b15-7974-4c6b-940b-27f8a8cd46ee None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:05.941479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 382/754] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:05 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:05.942729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:05.992532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:05.993728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:05.994119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:05.994510 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] PATH_INFO: `/v3/users/nova` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.001552 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:06.005310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.006980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:06.025564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:06.027009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:06.028233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:06.029997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 373/755] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:38:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:06.035315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.068392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182f99-8ccb-44c8-a1f0-a8c845537cbb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.096413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:06.118507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085090-c986-4573-9666-caac90713653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.119798 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085090-c986-4573-9666-caac90713653 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.120294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085090-c986-4573-9666-caac90713653 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.120818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085090-c986-4573-9666-caac90713653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.133742 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085090-c986-4573-9666-caac90713653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.135621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085090-c986-4573-9666-caac90713653 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-fb085090-c986-4573-9666-caac90713653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:06.154001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:06.155053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:06.155991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:06.155991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:06.155991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:06.155991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:06.158440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 383/756] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:06.163759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085090-c986-4573-9666-caac90713653 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.179997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ee4b-83dd-42fc-ac57-cba9fb920bab None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.235925 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.237930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.238722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.239235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.240996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:06.241524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.243691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.268558 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 374/757] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:06.274974 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.308172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:06.315104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085090-c986-4573-9666-caac90713653 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.351807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.352625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.353011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.353406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.354239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:06.354747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.356157 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.370121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 384/758] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:06.376667 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.393437 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:06.398177 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a66d5-f621-47a1-aabd-a772215cbae7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.436298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.437507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.438574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.439092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.450411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.452306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:06.471225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:06.472240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:06.473181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:06.473181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:06.473181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:06.473181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:06.475302 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 375/759] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:06.480807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.566696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7902-59ce-4833-8412-41d90a4e45a3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.608232 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d2ae-942f-484a-9096-62a2f8f18615 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.647231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.647824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.648111 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.648395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.649138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:06.649447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.650849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.653857 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.654657 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.654969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.655248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.670084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.671595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.679295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 376/760] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:06.690976 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:06.699992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:06.700958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:06.701996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 385/761] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:06.713183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:06.715520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.760438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:06.880638 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd7781-4016-4ab9-bd16-9a3062919a41 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.925287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238a2b-18fe-464c-b92a-9eee449f66ec None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:06.942990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.943868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.944160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.944854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:06.960748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:06.962233 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:06.987199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:06.988229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:06.989196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:06.995090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 377/762] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:06.997156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:06.998681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:06.999377 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:06.999662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:06.999942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:07.000775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:07.001088 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:07.002557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:07.032600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 386/763] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:07.035604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:07.148290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:07.210248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff13c-361a-4a5a-afce-e02f685bbe8f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:07.210933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:07.248125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841dd3f-6a31-458b-862d-9556a1c90067 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:07.289458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:07.290139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:07.290418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:07.290694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:07.291586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:07.292879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:07.294335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:07.320944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 378/764] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:07.322152 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:07.322831 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:07.323122 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:07.323398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:07.324234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=526cc7ffdc3a4af2b47481206e81bb44) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:07.324544 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:07.325964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:07.327518 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad181bb-7839-40fd-a311-69ef121dca27 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:07.334496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 387/765] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:07 2022] GET /identity/v3/role_assignments?user.id=526cc7ffdc3a4af2b47481206e81bb44&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:07.443444 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af1cc2-f5ce-4f10-9397-9216318c7447 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:07.492590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:07.499730 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173278a-24eb-4327-b99b-d439efac2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:07.501225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173278a-24eb-4327-b99b-d439efac2ed9 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:07.501503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173278a-24eb-4327-b99b-d439efac2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:07.501779 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173278a-24eb-4327-b99b-d439efac2ed9 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/d0d0efbde33d4360ad47bd0c7a545edd/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:07.504118 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173278a-24eb-4327-b99b-d439efac2ed9 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=d0d0efbde33d4360ad47bd0c7a545edd, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:07.505599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173278a-24eb-4327-b99b-d439efac2ed9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:07.534500 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 379/766] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:38:07 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/d0d0efbde33d4360ad47bd0c7a545edd/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:38:08.219743 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcfb63-3fb7-4b9c-b090-d06fc524662c None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.220276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcfb63-3fb7-4b9c-b090-d06fc524662c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.220276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcfb63-3fb7-4b9c-b090-d06fc524662c None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.222056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 388/767] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:08.228194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e9ea7-5180-400d-8ce0-76891f54614c None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e9ea7-5180-400d-8ce0-76891f54614c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.229314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e9ea7-5180-400d-8ce0-76891f54614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.256019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-4a0e9ea7-5180-400d-8ce0-76891f54614c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:08.257617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-4a0e9ea7-5180-400d-8ce0-76891f54614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:08.350019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 380/768] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:08.373223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcfb63-3fb7-4b9c-b090-d06fc524662c None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:08.505773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcfb63-3fb7-4b9c-b090-d06fc524662c None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:08.534935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a336-e588-4bbf-ad83-374be3a74e3e None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.535284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a336-e588-4bbf-ad83-374be3a74e3e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.535489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a336-e588-4bbf-ad83-374be3a74e3e None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.537020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 381/769] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:08.544358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.544651 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.544931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.556003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:08.557048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.557513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.557971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.570671 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:08.579700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:08.580672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:08.581564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:08.583789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:08.584157 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 389/770] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:08.585077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:08.594904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:08.599104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:08.720417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 382/771] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:08.746240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:08.802950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:08.804964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448fc7-2c92-4d33-b939-dfb2fa2b9030 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:08.862372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:08.863083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.863366 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.863644 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.864511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:08.864830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:08.866344 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:08.876455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 390/772] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:08.883856 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:08.887338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99f47-088d-4ce2-b7ed-cbf01710d8c9 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:08.935479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:08.937169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.938641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.939297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] PATH_INFO: `/v3/services/network` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.940568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:08.943042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-9b3747fe-7ff2-4c71-9813-98014540ebed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:08.961689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:08.962954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:08.963863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 383/773] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:08 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:08.964716 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a67ac-aab6-4c13-8c87-e62001050f90 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:08.964790 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a67ac-aab6-4c13-8c87-e62001050f90 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:08.965388 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a67ac-aab6-4c13-8c87-e62001050f90 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:08.975432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 384/774] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:08.975432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a67ac-aab6-4c13-8c87-e62001050f90 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:08.976054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.036347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11723a43-3827-4c14-836e-9135ab0f1072 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.101837 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.102925 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.103489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.103921 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.104042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a67ac-aab6-4c13-8c87-e62001050f90 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.119617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.120588 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.123336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-fff2d648-00af-4f4e-8896-7ce96fe33631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:09.147018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:09.148233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:09.149548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:09.149548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:09.149548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:09.149548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:09.150487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.151411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.151836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.152263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.153164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] RBAC: Adding query filter params (name=network) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:09.153609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.155154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 391/775] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:09.155438 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.156825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.157064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.157467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.161639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 385/776] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:09.162645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.180803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:09.182210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:09.266929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 392/777] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:09.268780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.278810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7892397-bd91-4a6e-8a1f-3efb3aebd1dc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.316753 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.317676 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.318069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.318453 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.319368 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:09.319851 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.321413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.333933 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 386/778] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:09.339012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.342983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.387075 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.415935 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ea7cd-d79c-4e8e-992e-b38e11f5072e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.461773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.462699 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.463440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.463829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.464938 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] RBAC: Adding query filter params (type=network) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:09.465352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.467367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.470672 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844f59-51ef-4f12-a1c8-c96f6ddd2bb9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.479158 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 393/779] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:09.480680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.519629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.521283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.521973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.522407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.523256 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.525989 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:09.543041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:09.544311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:09.545269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:09.554179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 387/780] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:09.554179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.608465 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e4ec-71b6-423f-b099-d6332352856d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.624491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.649094 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.650253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.650842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.651469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] PATH_INFO: `/v3/users/swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.660627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.661644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c821cb-fdf0-4c8e-922a-144a46121d41 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.662634 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.663264 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:09.681793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:09.682914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:38:09.683927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:09.686824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 394/781] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:09.688136 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.704125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.704831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.705229 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.705488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.706300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] RBAC: Adding query filter params (interface=public, service_id=d90e123f29484381805cfde50b106fda, region_id=RegionOne) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:09.707019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.708125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.721478 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 388/782] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/endpoints?service_id=d90e123f29484381805cfde50b106fda&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:09.722363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.809767 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fe38c-4db7-4fba-80fb-470015f0088e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.836023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6d92-c722-44fb-87e8-2927402a0b70 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:09.849183 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.850199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.850873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.851482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.852493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:09.853012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.854942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.865955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 395/783] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:09.867292 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.873271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:09.873949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:09.874238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:09.874521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:09.875452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:09.875768 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:09.877212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:09.902455 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 389/784] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:09.903503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:09.909082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.932533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:09.983910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32705203-013b-4507-b9d2-da008ba16e49 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.015469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3fff8-4ba1-48c8-945c-ad4c2c67409c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.029858 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.031077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.032627 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.033261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.034286 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.036090 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.041925 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 396/785] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:10.044392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.061022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.062482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.063018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.063518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.065357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:10.065893 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.067920 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fb4b-6ed2-4c37-bbba-5db45f3649df None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.076103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 390/786] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:38:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:10.077947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfde42-ad90-4761-bcd0-2b84ea386247 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.078411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfde42-ad90-4761-bcd0-2b84ea386247 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.079418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfde42-ad90-4761-bcd0-2b84ea386247 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.085452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 391/787] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:10.085452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfde42-ad90-4761-bcd0-2b84ea386247 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.184616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:10.188548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39356-1b6b-46cb-8fdd-8656b7883870 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.210980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:10.225670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfde42-ad90-4761-bcd0-2b84ea386247 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.231303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.232097 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.232641 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.232913 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.245130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.246599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.267351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.268124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.268521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.268868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-5e951921-91d1-45e9-8266-d143905ed213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:10.269262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:10.270479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:10.271596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:10.271596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:10.271596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:10.271596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:10.271835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] RBAC: Adding query filter params (interface=public, service_id=ab81084bd5594fdba3bfed6c4427de26, region_id=RegionOne) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:10.271835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.271835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9469-6733-44c7-87e4-6e6c3ae76af0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.277137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 397/788] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:10.277137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.277137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.277137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.277632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 392/789] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/endpoints?service_id=ab81084bd5594fdba3bfed6c4427de26&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:10.278970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ad0b1-20fd-4401-9276-559d3f8ecf92 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.279260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ad0b1-20fd-4401-9276-559d3f8ecf92 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.279537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ad0b1-20fd-4401-9276-559d3f8ecf92 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.281118 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 393/790] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:10.281861 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ad0b1-20fd-4401-9276-559d3f8ecf92 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.295867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:10.297406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:10.372714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 398/791] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:10.373683 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.402301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ad0b1-20fd-4401-9276-559d3f8ecf92 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.439986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.440909 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.441362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.441813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.442693 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:10.443189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.444626 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e06ba-2f0a-4d53-ba75-409bc23c0b2d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.461138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 394/792] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:10.461138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.461138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.461138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.476555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:10.477808 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:10.479086 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:10.488977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:10.498566 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15104b-c3d8-4b88-9f63-9d776c30c226 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.535259 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.535935 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.536225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.536506 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.537198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.538603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.554826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 399/793] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:10.554826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.575276 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 395/794] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:10.576401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.706249 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2aa9-da05-4e7c-8548-80e54fde4f93 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.713956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e93bc7-ddbb-41d0-b366-054989d36e88 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.746962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.747933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.748374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.748752 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.763330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.764134 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.764420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.764699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.768793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:10.775844 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.778041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:10.778974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:10.782248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 400/795] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:10.784466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.792775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:10.809504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:10.810628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:10.811622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 396/796] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:10.812138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.815042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:10.920678 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03feee6-2d48-45c6-b8e9-b88d9c98164c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.932568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98357-b5ad-45f5-8653-df879157171a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:10.958719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.959634 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.960030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.960421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.972047 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:10.977816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:10.978679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:10.979144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:10.979568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:10.980485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:10.980803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:10.981963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:10.983381 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:10.984503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:10.985597 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 401/797] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:10.986242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:10.986766 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:10.997919 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 397/798] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:10.999029 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.069607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.081564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.127573 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22cc96-4404-4a7e-8844-96e89e1b4cd9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.136001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7da90c-1620-4330-a696-f58ee01675af None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.179147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.179848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.180162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.180689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.181467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:11.181806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.183196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.185982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.187018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.187489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.188856 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.190695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:11.191545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.193396 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.198370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 398/799] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:11.199413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.213180 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 402/800] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:11.214691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.346723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be7d64-3369-41a7-9ccc-efff5cbd8020 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.348860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6cea-b85a-475a-8c69-af4a4547c5b0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.380765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.387375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.395054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.395904 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.396189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.396462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.402846 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.403653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.403943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.404223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.408541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.409995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.415628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.417108 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:11.428296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:11.429296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:11.430242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:11.430242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:11.430242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:11.430242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:11.430242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 399/801] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:11.431286 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:11.437352 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:11.440076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:11.442310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:11.442310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:11.442310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:11.442310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:11.451241 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 403/802] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:11.451241 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.537689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c77c-f0f6-43a3-bff0-c3353055670a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.559398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d26fc-a045-4e3e-ad0a-efabae3d937f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.573079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.573966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.574247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.574523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/112297493c5747209d968e2ed2d047e0/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.576685 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=112297493c5747209d968e2ed2d047e0, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.578128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.596238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 400/803] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:38:11 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/112297493c5747209d968e2ed2d047e0/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:38:11.597115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.602172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.602945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.603230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.603556 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.604315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:11.604631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.606242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.641796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 404/804] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:11.646954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.647875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.722258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e143-d87d-4040-8954-fb5c20fadda9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.742585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.767602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.768791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.769238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.769666 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.771016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:11.771532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.773092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.788473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 401/805] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:11.796637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:11.880658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec827-18ed-4bdb-958d-5151e7905294 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.947120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:11.948088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:11.949542 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:11.949829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:11.950383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:11.952520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4c49-8bf2-422d-9bad-8d46c92b7dd9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:11.963294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:11.965270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:11.990887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:11.991969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:11.993586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 405/806] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:11.997933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.013342 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.014141 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.014424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.014701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] PATH_INFO: `/v3/users/nova` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.027154 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.028613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:12.049313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:12.050340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:12.053034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 402/807] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:12.056957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.171967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:12.175709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0ac61-fa79-414d-81b1-6f8830ab7386 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.212714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.213393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.213682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.213961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.214815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:12.215145 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.216601 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.237019 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 406/808] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:38:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:12.242622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.284160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2b894-d1c9-4041-9e83-b23214a87afd None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.351385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f48a9e-2289-475d-bd59-04341e13eca5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.371425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.372170 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.372461 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.372736 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.373586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:12.373892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.375395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.387099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.387899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.388190 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.388469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.401154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.402721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:12.424930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:12.425956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:12.426968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:12.426968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:12.426968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:12.426968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:12.427220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 403/809] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:12.431204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 407/810] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:12.432059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.436508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.450414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:12.462258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:12.566260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538c7e-7249-444d-b02d-d335b82dabee None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.569432 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ce81-6686-44b9-bd6e-d0f526a37a4c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.612819 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.613400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.613688 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.613995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.614821 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:12.615132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.615807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5e92-78b7-43aa-873a-72cb9ebf504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.616531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aae2e-126a-439b-89bc-275abc1a7d74 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.616918 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5e92-78b7-43aa-873a-72cb9ebf504d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.617399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5e92-78b7-43aa-873a-72cb9ebf504d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.617980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5e92-78b7-43aa-873a-72cb9ebf504d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.634956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 408/811] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:12.636851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7f37-ee95-4164-a4d5-1d46f3126cad None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.637372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7f37-ee95-4164-a4d5-1d46f3126cad None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.637853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7f37-ee95-4164-a4d5-1d46f3126cad None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.644207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 409/812] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:12.645383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7f37-ee95-4164-a4d5-1d46f3126cad None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.708888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5e92-78b7-43aa-873a-72cb9ebf504d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.710631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5e92-78b7-43aa-873a-72cb9ebf504d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.720239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:12.731565 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:12.764007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7f37-ee95-4164-a4d5-1d46f3126cad None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.802211 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:12.803524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.804033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.804570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.813367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:12.815375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:12.831616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:12.832580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:12.833633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:12.840380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 404/814] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:38:12.840380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:12.840380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:12.840380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:12.840946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 410/814] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:12.842039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:12.860827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:12.862995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:12.971006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d473b5b-d092-4517-a1bb-4a0d9f4fa83c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:12.971716 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 405/815] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:12.973093 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.016560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.027111 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.027912 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.028197 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.028474 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.030239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.039641 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.041159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:13.060329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:13.061423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:13.062375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:13.062375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:13.062375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:13.062375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:13.066562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 411/816] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:13.067332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.098063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee477-2711-4b8f-ac0d-9feeb7bd6620 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.136151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.136734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.137022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.137301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.138098 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:13.138551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.140084 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.154849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 406/817] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:13.154849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.177293 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e415fe-8027-4ee7-9c2c-c58dc85a670b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.222999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.223814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.224107 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.224384 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] PATH_INFO: `/v3/services/network` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.225056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.226467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-bd74ab27-22ae-4d04-85b8-de3309873194 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:13.241172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:13.242564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:13.243950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 412/818] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:13.244924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05495-18c1-4890-9dcb-006d1957d79a None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.244924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05495-18c1-4890-9dcb-006d1957d79a None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.244924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05495-18c1-4890-9dcb-006d1957d79a None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.250919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 413/819] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:13.250919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05495-18c1-4890-9dcb-006d1957d79a None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.283774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717fbd6-9171-4289-a4c2-590c748ccdf2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.291358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.301590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.324380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.325042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.325325 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.325758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.326973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:13.327302 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.328700 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.346115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 407/820] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:13.346115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.372943 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05495-18c1-4890-9dcb-006d1957d79a None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.410372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06184b7f-b9d0-4974-8179-fd50e642ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.411214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06184b7f-b9d0-4974-8179-fd50e642ea52 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.411738 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06184b7f-b9d0-4974-8179-fd50e642ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.412030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06184b7f-b9d0-4974-8179-fd50e642ea52 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/526cc7ffdc3a4af2b47481206e81bb44/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.429625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06184b7f-b9d0-4974-8179-fd50e642ea52 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=526cc7ffdc3a4af2b47481206e81bb44, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.431252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06184b7f-b9d0-4974-8179-fd50e642ea52 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.452761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 414/821] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:38:13 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/526cc7ffdc3a4af2b47481206e81bb44/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:38:13.452761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.452761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.452761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.463449 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cbf77-fac7-43d4-a627-1bd681321182 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.471781 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:13.473213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:13.507875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.508953 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.509408 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.509864 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.510931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:13.511576 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.512991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.519899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 408/822] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:13.525798 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.571291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 415/823] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:13.571291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.572525 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.617557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.677929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fda35-8913-4e17-9264-452fd12c49e3 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.725587 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac7eb1-a31f-49d2-b7c6-dd2c3b7cbaf0 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.727145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.727940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.728218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.728487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.740123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.742702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:13.763602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:13.764606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:13.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:13.768658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 409/824] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:13.769667 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.773646 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.774743 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.774743 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.775270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.776083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] RBAC: Adding query filter params (type=network) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:13.776490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.778032 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.784459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 416/825] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:13.789762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.883245 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.894901 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f442b-24ea-4d50-b6b8-21816944f6a0 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.898378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:13.916719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f84d8-3fc3-436b-b047-311f332a2a23 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:13.937033 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.938537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.938980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.939357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.940241 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.941903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:13.957886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:13.959188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:38:13.960301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:13.967133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 410/826] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:13.967133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:13.971744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:13.972971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:13.972971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:13.973202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:13.974125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:13.974571 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:13.976157 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:13.995592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 417/827] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:13.996662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.079731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d2ee-7eb0-43e2-8158-65b537108531 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.107981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c5af-47e8-4bca-b9d6-09d7cd335913 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.114507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.115199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.115482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.115756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.116499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:14.117873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:14.142848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 411/828] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:14.142848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.158064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.159105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.159622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.160171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.161078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:14.161626 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:14.162236 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:14.164723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab819-c75d-45ac-9817-76e332fc0240 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:14.178442 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 418/829] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:38:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:14.180451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f866d-4a44-4551-bfc8-08f46622a5ae None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.180966 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f866d-4a44-4551-bfc8-08f46622a5ae None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.181463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f866d-4a44-4551-bfc8-08f46622a5ae None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.183748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 419/830] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:14.184930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f866d-4a44-4551-bfc8-08f46622a5ae None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.200814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:14.284418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2350a-e42b-49bb-b253-a2e3e9467013 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.325493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f866d-4a44-4551-bfc8-08f46622a5ae None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.334089 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.335007 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.335404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.335795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.336735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=d0d0efbde33d4360ad47bd0c7a545edd) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:14.337661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:14.339259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c83d0-3136-446f-8908-4b649cab3d29 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:14.349156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 412/831] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:14 2022] GET /identity/v3/role_assignments?user.id=d0d0efbde33d4360ad47bd0c7a545edd&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:14.350934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.351290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.351666 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.372263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.373268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.375049 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.375214 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:14.376331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.376757 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:14.377440 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:14.377920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:14.379538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:14.387527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 420/832] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:38:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:14.393785 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.467318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 413/833] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:14.495098 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:14.499201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.504496 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:14.540805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7680-ac48-426a-a44d-b1c48b5c60d3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.587554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.589133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.589636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.590384 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.591405 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:14.593013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:14.621276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 421/834] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:14.635523 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ef05-b865-4535-a4ec-83b87f32a6f8 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.686131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.686981 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.687267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.687545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.700838 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:14.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:14.710137 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:14.711149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 414/835] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:14.719705 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.834781 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe0603-bd3d-4354-b023-17ac3603a100 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:14.865237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:14.874335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:14.875169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:14.875580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:14.875980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:14.876858 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:14.877273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:14.879023 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:14.888914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 422/836] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:14.894507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:14.961321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:15.006092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bed5ec-c6d9-4424-89a9-f2cc76e39cbd None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:15.042046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:15.043164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.043706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.044145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.057613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:15.059410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:15.077549 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:15.078875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:15.080109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:15.080109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:15.080109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:15.080109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:15.081987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 415/837] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:15.087820 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:15.194092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7aef8-0a97-4abf-848f-4e3f42b0fa88 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:15.230504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:15.231483 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.231937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.232801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.233698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:15.234185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:15.235840 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:15.253323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 423/838] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:15.259076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:15.366773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e9ec-cecf-4bd9-8097-83b350699fe9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:15.387171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:15.408021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:15.409026 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.409560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.409848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.418054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:15.419526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:15.434064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:15.435188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:15.436267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 416/839] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:15.443389 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:15.497773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:15.554168 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f45508-219a-4f9c-a862-a1c6fbdfa84b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:15.596444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:15.597119 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.597400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.597674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.598664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:15.599002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:15.600461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302eb7-22ec-4114-a272-2d21d936bc02 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:15.619522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 424/840] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:38:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:15.627463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:15.748190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4fca4-6047-4884-8f04-c6e926d5f8c1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:15.784503 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:15.785161 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.785440 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.785723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.829633 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:15.858186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:15.860296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:15.864936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4999b-23e0-47cf-9f73-b97be0774061 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.865281 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4999b-23e0-47cf-9f73-b97be0774061 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.865579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4999b-23e0-47cf-9f73-b97be0774061 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.867396 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 425/841] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:15.873114 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:15.873721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:15.874209 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:15.891889 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:15.893584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:15.987567 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 417/842] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:38:15.994861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 426/843] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:15.996205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.017986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.070451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.081742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.113988 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2e78c-ccaf-4bdc-bf6a-91041b23555d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.141038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e420-71cf-44b4-95c6-3f9956930206 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.150628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.151762 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.152276 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.152777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.163751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.165497 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.178131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.179010 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.179297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.179625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:16.185277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:16.186242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:16.187326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:16.187326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:16.187326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:16.187326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:16.193903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:16.194237 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 418/844] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:16.195328 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:16.199074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:16.200086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:38:16.200998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:16.205799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 427/845] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:16.206646 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.306471 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7729cd7-c4a4-4d66-af32-0582ef77d155 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.311038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.315987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a26d-47c6-49bb-96a1-6f9581e7978e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.334727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.348082 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71264541-b525-436b-a20c-004872d38f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.349152 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71264541-b525-436b-a20c-004872d38f47 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.349663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71264541-b525-436b-a20c-004872d38f47 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.350171 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71264541-b525-436b-a20c-004872d38f47 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.351157 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71264541-b525-436b-a20c-004872d38f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:16.351700 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71264541-b525-436b-a20c-004872d38f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.353320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71264541-b525-436b-a20c-004872d38f47 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.359600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.361466 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.361602 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.361817 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.362586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:16.362922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.364561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.372555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 419/846] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:16.373742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71264541-b525-436b-a20c-004872d38f47 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.374874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 428/847] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:16.380363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.506560 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71264541-b525-436b-a20c-004872d38f47 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.520024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cadf1-3126-43b7-a50f-617a81450ad9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.554568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.555427 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.555714 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.555991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.557659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.558709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.559235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.559750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.565013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.566516 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.576801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.579395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:16.585661 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:16.586615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:16.587641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:16.590939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 420/848] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:16.593652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:16.602983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:16.603955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:16.604922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:16.604922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:16.604922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:16.604922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:16.608180 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 429/849] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:16.615740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.636244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.652769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.727594 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642504-6cfe-4f85-aff1-b67b7608bd1f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.740560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77ddab-355e-4b94-8a73-9f823a8a67c1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.778042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.778711 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.779023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.779305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.780097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:16.780407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.781878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.786758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.787735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.788248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.788750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.790114 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:16.790641 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.793014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.794834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 421/850] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:16.801098 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.818374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 430/851] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:16.819139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:16.916395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.940333 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dfeb2-c812-4b50-8609-e25fd41256c8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.943841 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:16.949255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8786-80ad-436f-ba88-6a72558a1689 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:16.975914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.976573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.976858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.977133 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.977965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=112297493c5747209d968e2ed2d047e0) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:16.978278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:16.979744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28195ed-9f21-418e-8385-ed98ddf5085b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:16.986058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:16.995097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 422/852] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/role_assignments?user.id=112297493c5747209d968e2ed2d047e0&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:16.995327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.995327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.995327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.995601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa269d37-6357-48e2-8799-fb278d6aaa62 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.995601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa269d37-6357-48e2-8799-fb278d6aaa62 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.995601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa269d37-6357-48e2-8799-fb278d6aaa62 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:16.995601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 423/853] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:16.995931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec520-8e74-4a8c-82ad-956e1209888c None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:16.995931 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec520-8e74-4a8c-82ad-956e1209888c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:16.996172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec520-8e74-4a8c-82ad-956e1209888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.006428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.008155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.019649 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-f80ec520-8e74-4a8c-82ad-956e1209888c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:17.021278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-f80ec520-8e74-4a8c-82ad-956e1209888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-35d0c18c-156f-4fd9-9109-1f125f673460 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:17.024972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:17.026093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:17.027139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 431/854] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:38:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:17.027827 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc19b-2b82-4c71-8626-95b3ac4710e5 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.028450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc19b-2b82-4c71-8626-95b3ac4710e5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.028450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc19b-2b82-4c71-8626-95b3ac4710e5 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.034260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 432/855] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:17.034260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc19b-2b82-4c71-8626-95b3ac4710e5 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.103508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 424/856] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:17.105287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.105798 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.106301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.128252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:17.130577 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:17.163342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc19b-2b82-4c71-8626-95b3ac4710e5 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.200124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.206780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.207508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.207789 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.208064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.208907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:17.209216 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.210659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.213632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 425/857] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:17.214394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.230371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 433/858] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:17.236675 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.249374 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.325202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49d4e-08cb-44bf-bd0b-a6e8cd686bf1 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.354970 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d484e-5a5b-4073-bba9-1ebf7806ca16 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.362272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.363245 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.364050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.364334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.364994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.366849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:17.381995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:17.383506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.384420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 426/859] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:17.385358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.396972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.398058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.398345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.398621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.459726 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.471990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.473398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.486337 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.497998 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de8b0-ee01-4bab-a5a7-95686f61ad92 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.533860 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.534662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.534982 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.535263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.535919 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.537285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:17.549282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:17.550367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.551315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 427/860] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:17.552186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.599457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 434/861] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:38:17.599457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.667558 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0022-7ede-48fb-82db-3272cad0d9eb None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.698604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.700532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.701199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.701481 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.701760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.702469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:17.702775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.704747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.709331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 428/862] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:17.710166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.716364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf9b72-cb74-4890-89b5-13631ccd698c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.734380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.757320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.758288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.758839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.759467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.760178 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:17.760490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.761989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.767676 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 435/863] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:17.768347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.820504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027da28-c795-49a9-ae94-c5a2d60212a4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.855349 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.856143 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.856422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.856687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.868197 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.869747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.877045 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b001fc-a061-419a-b1e4-a21fcfe28b9b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:17.887785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:17.888805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:17.889765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:17.889765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:17.889765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:17.889765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:17.889765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 429/864] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:17.891528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.919282 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:17.919926 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:17.920208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:17.920654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:17.921194 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:17.921501 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:17.922933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:17.928038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 436/865] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:17.928631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:17.957753 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:17.984209 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:18.025145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890cdc0-9e4d-47ed-b002-d03f003a81d4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:18.060625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2a615-9736-4d5a-89a0-46a159ab2ab2 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:18.065516 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:18.066280 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:18.066806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:18.067157 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:18.067961 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:18.068337 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:18.070021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:18.076170 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 430/866] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:18.108916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:18.110260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:18.110551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:18.110855 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:18.111625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:18.111936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:18.113476 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:18.131101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 437/867] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:18.136231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:18.255316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a072b-98aa-4b9d-ab98-feff31475a96 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:18.292003 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:18.292817 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:18.293103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:18.293381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:18.296422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:18.302198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:18.303875 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:18.319477 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:18.320488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:18.321886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 431/868] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:18.327022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:18.414824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:18.439928 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4344-d793-473e-8073-672dab6d1ed1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:18.475059 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:18.475722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:18.476004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:18.476284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:18.477068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:18.477376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:18.478846 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8130f4-0215-40d4-86eb-90019a64a360 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:18.492600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 438/869] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:18.498261 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:18.606921 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68790325-62cf-4c57-8907-032ac02b99ad None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:18.642580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:18.643270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:18.643555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:18.643832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:18.644664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=526cc7ffdc3a4af2b47481206e81bb44) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:18.644977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:18.646420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4ec7-6dbb-4bae-9494-0d0d90da04ec None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:18.653196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 432/870] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:18 2022] GET /identity/v3/role_assignments?user.id=526cc7ffdc3a4af2b47481206e81bb44&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:19.331576 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8fb7-7c8d-4bc6-8e6c-d013c1481936 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:19.332199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8fb7-7c8d-4bc6-8e6c-d013c1481936 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:19.332199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8fb7-7c8d-4bc6-8e6c-d013c1481936 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:19.333910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 439/871] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:19.339850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:19.340447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:19.340602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:19.358211 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:19.359439 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:19.417801 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:19.430775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 433/872] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:19.454030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8fb7-7c8d-4bc6-8e6c-d013c1481936 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:19.561103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8fb7-7c8d-4bc6-8e6c-d013c1481936 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:19.597959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:19.598778 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:19.599091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:19.599368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:19.600030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:19.601420 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:19.614986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:19.617385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:19.619588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 440/873] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:19.623142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:19.727361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00adf1e-8a3c-4096-b9e4-c95aff5358e2 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:19.763660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:19.764326 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:19.764609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:19.764882 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:19.765589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:19.765928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:19.767341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f53a1-4e41-4360-abd2-52bc60dc5b3d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:19.772463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 434/874] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:19.778120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:19.781359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:19.888386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0daa-f35a-4b89-87e2-0dffdf89d901 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:19.926407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:19.927492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:19.928028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:19.928523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:19.929456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:19.929996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:19.931620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295065-f67c-44b1-a325-d9433c05d3e8 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:19.937254 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 441/875] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:20.260795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788824-b89f-4baf-bf14-ab1ab60f4d11 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:20.261139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788824-b89f-4baf-bf14-ab1ab60f4d11 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:20.261457 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788824-b89f-4baf-bf14-ab1ab60f4d11 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:20.263110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 435/876] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:20.269114 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f03b5b-bbe3-4a46-bf0a-08f78ef70fb2 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:20.269782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f03b5b-bbe3-4a46-bf0a-08f78ef70fb2 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:20.270064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f03b5b-bbe3-4a46-bf0a-08f78ef70fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:20.287804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-d2f03b5b-bbe3-4a46-bf0a-08f78ef70fb2 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:20.288995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-d2f03b5b-bbe3-4a46-bf0a-08f78ef70fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:20.358168 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:20.368978 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 442/877] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:20.391830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42788824-b89f-4baf-bf14-ab1ab60f4d11 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:20.449735 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:20.500992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42788824-b89f-4baf-bf14-ab1ab60f4d11 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:20.536975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:20.537625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:20.537908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:20.538184 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:20.538960 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:20.540452 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:20.549875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d885-e2de-4e45-a6d6-1f879897df90 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:20.550227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d885-e2de-4e45-a6d6-1f879897df90 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:20.550557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d885-e2de-4e45-a6d6-1f879897df90 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:20.552338 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 443/878] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:20.560511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbef58-d13b-41d6-af76-6c8fe9612f4b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:20.560511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbef58-d13b-41d6-af76-6c8fe9612f4b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:20.560774 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbef58-d13b-41d6-af76-6c8fe9612f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:20.561016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 436/879] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:20 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:20.580718 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-21dbef58-d13b-41d6-af76-6c8fe9612f4b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:20.582087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-21dbef58-d13b-41d6-af76-6c8fe9612f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:20.670958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 444/880] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:20 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:20.693983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:20.805932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54d26-8ec1-4fac-afb3-f3f717c5ecd7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:20.822826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:20.847609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc96a5-f737-487c-936f-4c770aeb4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:20.848959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc96a5-f737-487c-936f-4c770aeb4b2a None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:20.849247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc96a5-f737-487c-936f-4c770aeb4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:20.849525 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc96a5-f737-487c-936f-4c770aeb4b2a None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:20.850297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc96a5-f737-487c-936f-4c770aeb4b2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:20.851769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc96a5-f737-487c-936f-4c770aeb4b2a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:20.869982 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 437/881] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:20 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:21.043161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028ae2-1c08-4a16-867e-6ab4b0d22848 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:21.043527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028ae2-1c08-4a16-867e-6ab4b0d22848 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:21.043760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028ae2-1c08-4a16-867e-6ab4b0d22848 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:21.045581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 445/882] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:21.053589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:21.053898 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:21.054162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:21.072607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:21.073724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:21.154043 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 438/883] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:21.178361 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028ae2-1c08-4a16-867e-6ab4b0d22848 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:21.299353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028ae2-1c08-4a16-867e-6ab4b0d22848 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:21.323424 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:21.336530 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:21.337825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:21.338584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:21.338888 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:21.350232 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:21.358723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:21.360242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:21.361207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 446/884] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:38:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:21.368553 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:21.469640 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:21.473585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4f630-0df4-454b-97aa-61f7e1085f47 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:21.510935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:21.512191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:21.512688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:21.513165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:21.514177 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:21.514694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:21.516884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:21.525865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 439/885] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:38:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:21.531667 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:21.639998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792914be-2c6a-458c-b105-ff8d5a1bd080 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:21.675305 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:21.676102 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:21.676388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:21.676664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:21.688430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:21.689914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:21.708252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:21.709242 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:21.710199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:21.710199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:21.710199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:21.710199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:21.710199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 447/886] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:21.716712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:21.830048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd569a-02ed-44cd-853e-2396f0e2c59a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:21.866038 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:21.867127 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:21.867637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:21.868147 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:21.869110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:21.869641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:21.871275 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:21.885857 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 440/887] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:21.891769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:21.928721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:21.999527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003555-410c-40fc-8789-f7bf4195b875 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:22.033849 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:22.034981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.035504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.036015 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.043841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:22.045538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:22.061135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:22.062208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:22.063859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:22.066760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 448/888] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:38:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:22.073034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:22.104720 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:22.183758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a422ca2-6f15-476a-b13e-5b18c5681684 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:22.220183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:22.221247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.221763 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.222269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.223365 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:22.223918 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:22.225577 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bba62-fbcb-49e8-9e95-02f75260bad1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:22.245438 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 441/889] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:38:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:22.251981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:22.271247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7073f-4a69-4194-8024-79db8327c5b8 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.271760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7073f-4a69-4194-8024-79db8327c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.272050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7073f-4a69-4194-8024-79db8327c5b8 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.273705 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 442/890] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:22.279629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.280220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.280732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.299377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:22.301014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:22.379070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 443/891] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:22.381345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:22.386632 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c55a2-34b9-472b-8301-abca182c1fb4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:22.402093 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:22.427633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:22.428556 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.429021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.429481 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.435232 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:22.503525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:22.505253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:22.577528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0637-3fa0-4f23-982a-2f9f280bdc5e None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:22.616985 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:22.621109 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:22.622097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.622633 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.623162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.624142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:22.626755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:22.630331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 449/892] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:22 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:38:22.641277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:22.655485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 444/893] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:22 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:38:22.782814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e57b5-b54d-4828-8bca-5fe88cc1ffd4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:22.840357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:22.841183 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.841472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.841752 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.854131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:22.855648 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a2491632-fe04-4a12-bb45-32ae5619078b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:22.875291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:22.876303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:22.877298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:22.877298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:22.877298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:22.877298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:22.877298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 450/894] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:22.884040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:22.950603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5ced-a42a-4d0f-9a34-4481d1a98a10 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.951279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5ced-a42a-4d0f-9a34-4481d1a98a10 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.951773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5ced-a42a-4d0f-9a34-4481d1a98a10 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.954032 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 451/895] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:22.960756 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:22.961067 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:22.961309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:22.983410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.003918 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:23.005159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:23.040647 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739a14-eded-4c76-9fda-bc42d6332eca None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.056570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.089385 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.091039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.091551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.092288 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.093474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:23.094046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.096285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.100005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 452/896] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:23.112856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 445/897] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:23.118543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.122277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.242268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046387de-8c1d-45b1-84ac-bd5e5a99be69 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.262851 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368967c-25bb-49bc-8f81-9a842f08c6b1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.281909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.282727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.283043 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.283324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.291271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.292792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.294132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.304101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.304914 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.305194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.305464 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.306123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.307529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:23.309981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:23.310991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:23.311963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:23.316563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 453/898] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:23.317412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:23.320910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:23.322995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:23.324131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 446/899] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:23.330812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.351876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.431355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1cd7a-a8a2-4674-afab-74018c2d92b8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.435933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dba32-5fbc-4a19-86e1-faba5546bfd4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.466758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.467495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.467782 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.468307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.468756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:23.469201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.470454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3ce4-ca0c-4c2e-ab43-5715a99bc018 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.473347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.474017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.474307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.474586 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.479983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:23.480143 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 447/900] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:23.480273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.480378 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba524-0cb4-48d5-a206-6b50aad14287 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.480478 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e450c-c102-4c8e-9c30-b7097f206976 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.480583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba524-0cb4-48d5-a206-6b50aad14287 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.480583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba524-0cb4-48d5-a206-6b50aad14287 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.480583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 448/901] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:23.485387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba524-0cb4-48d5-a206-6b50aad14287 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.498101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 454/902] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:23.499995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.500856 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.501137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.520847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:23.522068 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:23.551119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.595405 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba524-0cb4-48d5-a206-6b50aad14287 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.598839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 455/903] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:23.598839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.637060 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.641941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.642921 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.643205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.643632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.644659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:23.645102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.646602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.657248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 449/904] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:23.657248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.715778 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432154c-008a-46e4-b460-0dc6a36354c3 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.755615 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.756310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.756592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.756864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.757690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] RBAC: Adding query filter params (role.id=1c2efabd2b9a49b6bf9b6489efcc7a37, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=526cc7ffdc3a4af2b47481206e81bb44) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:23.757997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.759472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.765150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 456/905] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/role_assignments?user.id=526cc7ffdc3a4af2b47481206e81bb44&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=1c2efabd2b9a49b6bf9b6489efcc7a37 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:23.775035 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.779123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae74a-87ba-4c6f-bc77-951e9d2d8a40 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.807356 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.820905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.821721 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.822231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.822516 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.824102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.825507 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:23.849272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:23.851102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:23.852041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 450/906] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:23.857659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:23.892110 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:23.914383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04462-9e7f-4ba2-a11d-4b3539242349 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:23.958267 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:23.959341 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:23.959837 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:23.960355 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:23.961371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] RBAC: Adding query filter params (interface=public, service_id=9c86a283c7a04bf088953c05131c4cd2, region_id=RegionOne) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:23.961898 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:23.963567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:23.972790 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 457/907] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/endpoints?service_id=9c86a283c7a04bf088953c05131c4cd2&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:23.979572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:24.013386 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c706-a185-4a0a-9bf2-0a29319abd7c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:24.057007 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:24.059063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:24.059641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:24.060152 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:24.061131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:24.061650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:24.063885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:24.071144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 451/908] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:24.076029 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:24.090208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99deb3b-dcd8-4ba3-b9eb-4755f574cc0b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:24.132881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:24.133557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:24.133838 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:24.134113 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:24.135134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:24.136677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:24.142112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:24.144863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 458/909] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:23 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:38:24.205651 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba234d-05e9-41d1-9069-d0f9d7032d97 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:24.243923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:24.244604 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:24.244886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:24.245160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:24.245882 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:24.246185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:24.247767 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:24.253940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 452/910] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:24.261443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:24.293020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:24.381227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b865e-bc60-45be-b196-ef59fdb31b10 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:24.421008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:24.421972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:24.422270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:24.422519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:24.423376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] RBAC: Adding query filter params (interface=public, service_id=96226a7343074541b75fb6dc1e896ce6, region_id=RegionOne) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:24.423686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:24.425087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f6b7-4875-4d98-a72b-4b879793cd4d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:24.431341 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 459/911] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:24 2022] GET /identity/v3/endpoints?service_id=96226a7343074541b75fb6dc1e896ce6&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:24.436786 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:24.545073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42293d-c96d-4497-8b89-2924af679035 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:24.559840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:24.581766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e2c6a-3ea4-4911-bad6-de2a65a3421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:24.582434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2c6a-3ea4-4911-bad6-de2a65a3421e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:24.582714 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2c6a-3ea4-4911-bad6-de2a65a3421e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:24.583018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2c6a-3ea4-4911-bad6-de2a65a3421e None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:24.583709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e2c6a-3ea4-4911-bad6-de2a65a3421e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:24.585078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e2c6a-3ea4-4911-bad6-de2a65a3421e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:24.591609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 453/912] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:24 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:38:25.079270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc228-5e4f-416a-bfe6-e1f3bb7ae3f5 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:25.079974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc228-5e4f-416a-bfe6-e1f3bb7ae3f5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:25.079974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc228-5e4f-416a-bfe6-e1f3bb7ae3f5 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:25.081544 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 460/913] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:25.087082 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:25.087680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:25.087680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:25.109322 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:25.111367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:25.190761 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 454/914] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:25.213535 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dc228-5e4f-416a-bfe6-e1f3bb7ae3f5 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:25.314898 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:25.339208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dc228-5e4f-416a-bfe6-e1f3bb7ae3f5 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:25.374851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:25.376461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:25.376916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:25.377339 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:25.378134 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:25.379710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:25.393532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:25.394909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:25.396002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:25.398677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 461/915] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:25.410824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:25.513340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b2b31-ee9a-4f46-b979-b017b5b49d01 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:25.525115 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:25.552381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:25.553054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:25.553334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:25.553609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:25.554321 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:25.554626 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:25.556029 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:25.561497 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 455/916] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:25.567622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:25.678616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9bff9-2554-4376-9b51-721bf310f251 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:25.714437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:25.715426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:25.715896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:25.716382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:25.717279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:25.717781 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:25.719394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:25.724957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 462/917] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:25.730815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:25.839330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08537c4f-2ce7-4e88-887c-41e467137686 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:25.876228 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:25.876938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:25.877223 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:25.877490 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:25.878284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] RBAC: Adding query filter params (interface=public, service_id=964affb47ebe4542a279470113d5915a, region_id=RegionOne) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:25.878591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:25.880194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0affc5-b978-44e7-bf63-92b279d73b93 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:25.885996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 456/918] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:25 2022] GET /identity/v3/endpoints?service_id=964affb47ebe4542a279470113d5915a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:25.892030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:25.901323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:26.004749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad52-01bf-43a5-b437-f942b3647606 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:26.040089 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e31dd-a8a1-47d9-9538-a4756ed14e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:26.041143 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e31dd-a8a1-47d9-9538-a4756ed14e8a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.041666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e31dd-a8a1-47d9-9538-a4756ed14e8a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.042155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e31dd-a8a1-47d9-9538-a4756ed14e8a None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.043080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e31dd-a8a1-47d9-9538-a4756ed14e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:26.044663 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e31dd-a8a1-47d9-9538-a4756ed14e8a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:26.052108 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 463/919] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:25 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:38:26.145952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8f97-450e-4da2-892d-6f3edf11f5db None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.146519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8f97-450e-4da2-892d-6f3edf11f5db None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.146519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8f97-450e-4da2-892d-6f3edf11f5db None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.148180 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 457/920] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:26.153864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.154820 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.155325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.178832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:26.180053 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:26.252826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:26.260021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 464/921] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:26.284608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8f97-450e-4da2-892d-6f3edf11f5db None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:26.324125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:26.400023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8f97-450e-4da2-892d-6f3edf11f5db None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:26.436925 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105177f1-fc4c-4402-866c-e86a7945ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:26.438377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105177f1-fc4c-4402-866c-e86a7945ebc2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.438636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105177f1-fc4c-4402-866c-e86a7945ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.438943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105177f1-fc4c-4402-866c-e86a7945ebc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.449833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105177f1-fc4c-4402-866c-e86a7945ebc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-105177f1-fc4c-4402-866c-e86a7945ebc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:26.458123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:26.459191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:26.460095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 458/922] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:38:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:26.467557 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:26.572410 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5418-32f7-4077-8f98-82c9a15ee31c None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.572611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5418-32f7-4077-8f98-82c9a15ee31c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.573160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc5418-32f7-4077-8f98-82c9a15ee31c None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.574810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 459/923] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:26.574948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d539d4-d12c-47e9-b6ba-1f9e333e22a8 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:26.580008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.580302 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.580589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.598151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:26.599382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:26.618992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:26.619672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.619959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.620238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.621013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:26.621297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:26.622715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:26.631740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 465/924] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:38:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:26.638098 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:26.685702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 460/925] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:26.709100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:26.720716 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:26.739893 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:26.768371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a077a-f388-49eb-9a36-531c6b5d51a9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:26.805580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:26.806635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.807012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.807465 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.819398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:26.821109 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:26.826153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c958-421c-45e0-aedd-131ef1287481 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:26.839662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:26.840870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:26.842046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:26.842046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:26.842046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:26.842046 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:26.842761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 466/926] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:26.852015 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:26.879607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:26.880831 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:26.881335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:26.881865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:26.882808 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:26.885212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:26.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:26.900654 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:38:26.901580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:26.904680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 461/927] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:38:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:26.914871 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.000408 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0716ae-054a-4885-b320-5a568f88748d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.015350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.033675 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.041118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.042011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.042534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.043018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.044078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:27.044574 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.046214 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a838f2-64b5-45b6-99d9-efe9ace890ad None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.047607 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52f2ad-d6a0-4e11-a4cd-4dc8cab92504 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.061281 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 467/928] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:27.062653 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ed1e-f001-4568-80d4-8f4134c71e10 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.062980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ed1e-f001-4568-80d4-8f4134c71e10 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.063257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ed1e-f001-4568-80d4-8f4134c71e10 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.064625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 468/929] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:27.066569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ed1e-f001-4568-80d4-8f4134c71e10 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.094736 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.095488 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.095785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.096057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.096756 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:27.097069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.098443 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690daa1-95bb-4a87-8b38-67c7f51e35aa None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.106825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 462/930] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:27.106825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.106825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.106825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.123415 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:27.124670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:27.184764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ed1e-f001-4568-80d4-8f4134c71e10 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.202922 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 463/931] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:27.202922 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.230021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.231260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.231680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.232074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.243063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.244580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:27.264027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:27.265221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:27.266864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:27.272092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 469/932] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:27.273054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.310885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.320270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.342220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799c76d-f5cc-46b9-907e-fb6bc79caec5 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.380859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.381451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.382142 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.382421 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.383162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:27.383467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.385095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.390320 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 464/933] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:27.394863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4110a-b776-4346-9ea9-a620f43e6690 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.395927 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.431518 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08676171-d0e1-48c6-8196-002075223525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.432441 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08676171-d0e1-48c6-8196-002075223525 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.432729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08676171-d0e1-48c6-8196-002075223525 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.433013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08676171-d0e1-48c6-8196-002075223525 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.433732 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08676171-d0e1-48c6-8196-002075223525 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.435228 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08676171-d0e1-48c6-8196-002075223525 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-08676171-d0e1-48c6-8196-002075223525 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:27.448364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:27.449444 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:27.450329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 470/934] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:27.452684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08676171-d0e1-48c6-8196-002075223525 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.503918 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8c3e-f539-43d6-a29e-acea505a7886 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.540026 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.540683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.540972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.541242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.542073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:27.542381 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.543829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.553614 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.558048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08676171-d0e1-48c6-8196-002075223525 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.561793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 465/935] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:27.562646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.571205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.601864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.602618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.603025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.603375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.604185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.605644 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.628367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 471/936] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:27.629064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.705313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db919f89-53a1-4a03-a3bd-21591677861b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.761656 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.762923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.763466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.763784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc950bb-bb3d-499c-addc-2e5212aa83ed None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.764139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.765054 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:27.766300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.768125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.779144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 466/937] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:27.780617 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.804577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.805517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.805867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.806212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.819994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.821811 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:27.842082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:27.843163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:27.844188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:27.844188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:27.844188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:27.844188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:27.844188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 472/938] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:27.848700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:27.861468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.867406 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:27.914586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1bbef-8046-403a-8840-7f1596c0811b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.961014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:27.962354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:27.962764 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:27.963181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:27.964295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:27.964706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:27.966929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:27.974701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 467/939] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:27.978828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed208-624f-412b-9218-f1ab1d0cf3c5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:27.981222 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:28.019562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86225215-656a-424b-9355-02140f378504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.020233 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86225215-656a-424b-9355-02140f378504 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.020709 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86225215-656a-424b-9355-02140f378504 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.020997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86225215-656a-424b-9355-02140f378504 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.021725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86225215-656a-424b-9355-02140f378504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:28.022033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86225215-656a-424b-9355-02140f378504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.023459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86225215-656a-424b-9355-02140f378504 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.036625 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 473/940] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:28.041726 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86225215-656a-424b-9355-02140f378504 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:28.104783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b8ff2-002d-4e14-a064-0d0f4f0648d1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:28.117800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:28.138856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:28.145852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.146710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.147199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.147634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.148536 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.150206 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.159302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86225215-656a-424b-9355-02140f378504 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:28.172819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 468/941] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:28.211511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.212854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.213373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.213836 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.223298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.224929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a38f48dc-70d2-4a86-9c12-68d8ff86798c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:28.241620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:28.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:28.243792 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 474/942] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:28.249367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:28.377576 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee74ae-5e5f-44dd-8913-80a4b7a23739 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:28.408395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27332-afd9-4f48-a19e-1f3190fb84f6 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.408681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27332-afd9-4f48-a19e-1f3190fb84f6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.408959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a27332-afd9-4f48-a19e-1f3190fb84f6 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.410689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 475/943] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:28.416789 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.417075 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.418476 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.419749 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.420426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.420709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.420983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.424061 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:28.424383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.425823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.439933 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 469/944] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:28.441603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:28.444256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:28.446518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:28.503959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:28.536900 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 476/945] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:28.560962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:28.564733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082390-65cb-48a3-b190-36d7badc8b1b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:28.602992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.603996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.604274 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.604544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/526cc7ffdc3a4af2b47481206e81bb44/roles/1c2efabd2b9a49b6bf9b6489efcc7a37` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.606950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=526cc7ffdc3a4af2b47481206e81bb44, role_id=1c2efabd2b9a49b6bf9b6489efcc7a37)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.608656 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.626706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 470/946] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:38:28 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/526cc7ffdc3a4af2b47481206e81bb44/roles/1c2efabd2b9a49b6bf9b6489efcc7a37 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:38:28.637193 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:28.698981 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7905a-1c74-472d-ab27-8c2e6d635d2e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:28.739153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.739997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.740274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.740551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.741222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.742639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:28.756025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:28.757137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:28.758027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 477/947] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:28.763977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:28.880823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f25c10-ff11-48a5-9fb5-caa052b8fe59 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:28.889487 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:28.922439 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:28.923144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:28.923433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:28.923712 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:28.924431 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:28.924738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:28.926117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:28.934900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 471/948] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:28.937344 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:29.054631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e870f-fe57-4100-b888-d3583ecc8c19 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:29.071977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:29.091086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:29.091759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:29.092044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:29.092320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:29.093037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:29.093347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:29.094778 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34d8ea-b261-4f53-96c7-f5ff5a9f9315 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:29.100423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 478/949] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:29.105942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:29.219805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173cc1-f5db-434e-9cf3-74704370b816 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:29.261775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b13575-376e-4bcc-bb94-624f581e85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:29.261775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13575-376e-4bcc-bb94-624f581e85e7 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:29.261775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13575-376e-4bcc-bb94-624f581e85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:29.261775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13575-376e-4bcc-bb94-624f581e85e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:29.262597 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b13575-376e-4bcc-bb94-624f581e85e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:29.263895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b13575-376e-4bcc-bb94-624f581e85e7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:29.287455 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 472/950] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:30.036865 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125026-36f8-4f93-a49c-ecdb3f633f0b None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.037403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125026-36f8-4f93-a49c-ecdb3f633f0b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.037403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125026-36f8-4f93-a49c-ecdb3f633f0b None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.039116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 479/951] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:30.044673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.044971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.045261 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.063328 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:30.064524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:30.086364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:30.150631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 473/952] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:30.175275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125026-36f8-4f93-a49c-ecdb3f633f0b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:30.289975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125026-36f8-4f93-a49c-ecdb3f633f0b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:30.331507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:30.332721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.333223 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.333713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] PATH_INFO: `/v3/services/compute` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.334603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:30.336300 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:30.349558 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:30.350696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:30.351629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:30.354621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 480/953] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:30.360573 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:30.472163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76bee4-6af1-4880-ac58-95b1ed0b6abe None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:30.509347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:30.510029 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.510313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.510591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.511357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] RBAC: Adding query filter params (name=compute) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:30.511662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:30.513090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29278-4084-4341-bf62-7ed0a6548a60 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:30.520122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 474/954] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:30.525871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:30.579258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:30.635399 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b854-1296-4de4-a8a3-5632388ee338 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:30.671680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:30.672388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.672676 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.672952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.673664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] RBAC: Adding query filter params (type=compute) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:30.673971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:30.675394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7d987-b6b1-4222-a139-ff1069453a63 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:30.680622 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 481/955] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:30.726518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa636f-c6d5-4afa-b7e0-6f3efd34cad2 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.726895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa636f-c6d5-4afa-b7e0-6f3efd34cad2 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.727119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa636f-c6d5-4afa-b7e0-6f3efd34cad2 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.728656 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 475/956] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:30.734447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c42d2-1b3c-4391-b6ea-164496de3674 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:30.734762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c42d2-1b3c-4391-b6ea-164496de3674 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:30.735063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c42d2-1b3c-4391-b6ea-164496de3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:30.754175 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-215c42d2-1b3c-4391-b6ea-164496de3674 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:30.755459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-215c42d2-1b3c-4391-b6ea-164496de3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:30.832832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 482/957] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:30.856586 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa636f-c6d5-4afa-b7e0-6f3efd34cad2 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:30.880849 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:30.978597 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa636f-c6d5-4afa-b7e0-6f3efd34cad2 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.015987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.016658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.016951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.017231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.017949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.019539 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:31.021039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: WARNING keystone.server.flask.common [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:38:31.041793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.sql.core [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:38:31.041793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:38:31.041793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [parameters: {'id': 'd8bf056fd66141a5a657480b7f3b1f9e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:38:31.041793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=206998) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:38:31.049714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b43d-7fbc-4a56-a7c6-7ea5c821e8d3 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.050199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b43d-7fbc-4a56-a7c6-7ea5c821e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.050285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b43d-7fbc-4a56-a7c6-7ea5c821e8d3 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.051962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 483/958] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:31.056983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.057277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.057563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8bf056fd66141a5a657480b7f3b1f9e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8bf056fd66141a5a657480b7f3b1f9e. May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application conn.query(q) May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:38:31.060548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application result.read() May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 14:38:31.061428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application next(self.gen) May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application yield resource May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application next(self.gen) May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise self.value May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application session.commit() May 19 14:38:31.063105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self.session.flush() May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application compat.raise_( May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:38:31.064117 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:38:31.065096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application conn.query(q) May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application result.read() May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:38:31.065995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [parameters: {'id': 'd8bf056fd66141a5a657480b7f3b1f9e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.068852 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:31.070870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8bf056fd66141a5a657480b7f3b1f9e. May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 476/959] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:38:30 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:31.073122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.080493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:31.081804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:31.115637 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:31.164154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 484/960] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:31.164351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:31.183932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.198866 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445ffcc-b86c-480b-8f88-70ed77183916 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.243053 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.244362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.244889 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.245426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.253938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.255949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:31.274308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:31.275305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:31.276290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.278946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 477/961] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:31.285010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.326368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef03db-05a0-4d6c-8770-b298a7c3403f None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.364699 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.365429 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.365770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.365983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.377029 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:31.385320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:31.386393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:31.387340 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:31.391061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 485/962] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:31.392815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.428520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b715e-822b-44b8-89fb-edf70aa0fbb5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.434579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:31.462923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:31.469383 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.470886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.471199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.471479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.472388 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:31.472710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.474157 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:31.503312 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 478/963] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:31.526707 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68140b28-7cb8-4598-9e03-3c442095bda9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.567005 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.568091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.568626 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.569121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.570141 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:31.570690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.572409 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d656-0562-4321-83a8-96cf2bd51b81 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:31.582717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 486/964] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:31.590928 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.602582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387219c1-7a66-40b7-8150-d22a2ea32257 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.602959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387219c1-7a66-40b7-8150-d22a2ea32257 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.603184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387219c1-7a66-40b7-8150-d22a2ea32257 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.604987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 487/965] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:31.611998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.612916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.613363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.637672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:31.639250 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:31.717386 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 488/966] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:31.726992 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a6356-422d-4e72-8a47-16c8da596770 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.741022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.770563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.770948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:31.771990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.772469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.772469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.786822 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.788608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:31.809436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:31.810460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:31.811454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:31.811454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:31.811454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:31.811454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:31.814932 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 479/967] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:31.817070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.877574 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296be2a-eb3c-438f-8fc8-58c7d7614a44 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.879629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:31.927287 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.928618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.929118 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.929600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.930482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.932349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:31.945860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:31.947002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:31.947929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:31.948742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee349bf-0d43-4e36-b344-ebfa76bb5581 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:31.951191 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 489/968] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:31.963533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:31.988234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:31.989032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:31.989324 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:31.989597 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:31.990338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:31.990650 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:31.992088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.006866 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 480/969] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:32.017856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.072218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:32.090982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d62ac-b774-46d7-a3f1-67859a97c668 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.128521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.129446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.129927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.130359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.131261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:32.131738 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.133374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.142893 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 490/970] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:32.145452 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.151818 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a0713-f75a-4578-89cb-79fb3f8d01af None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.155018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:32.197284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.198104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.198387 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.198664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.208859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.210610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:32.237991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:32.239123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:38:32.240465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:32.241627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 481/971] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:32.249776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.283607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9623ef-4d14-4171-b61d-538d76dcdbe7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.319719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.320851 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.321341 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.321822 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.322745 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:32.323290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.324877 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.330735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 491/972] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:32.336567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.357871 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:32.368480 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c771eb-348a-4c72-b1a7-dc44c0b80300 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.414701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.416034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.416748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.417345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.419094 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:32.419596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.422286 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.455108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 482/973] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:32.456002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.469845 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d7437-4316-40e9-9044-5c87dcc73721 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.490097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:32.510083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.510748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.511079 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.511796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.512257 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] RBAC: Adding query filter params (interface=admin, service_id=964affb47ebe4542a279470113d5915a, region_id=RegionOne) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:32.512573 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.514286 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.525714 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 492/974] 10.222.0.71 () {56 vars in 1249 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/endpoints?service_id=964affb47ebe4542a279470113d5915a&interface=admin®ion_id=RegionOne => generated 193 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:32.527127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.594806 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd241-c194-44bb-8caa-49e0088b9296 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.624075 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:32.644474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.645683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.646165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.646709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.650213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42365c-a066-450d-8a7d-66c8a656afb3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:32.686382 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:32.687271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:32.687689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:32.688067 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:32.688861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.690447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.703830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 493/975] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:38:32.730270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:32.732042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:32.760008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:32.851359 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 483/976] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:38:32.860070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:32.972395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a2a5d-07d2-4871-a1ae-d0a3cad9bb79 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:33.008581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:33.009662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.010110 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.010578 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.021132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:33.023619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:33.027029 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f8b96079-d353-434a-ba12-f76e6c4dc87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:33.043759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:33.045125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:33.046306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:33.046306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:33.046306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:33.046306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:33.048744 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 494/977] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:33.054653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:33.060427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970826-4f10-44b8-a140-6c7419848d9b None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.060721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970826-4f10-44b8-a140-6c7419848d9b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.061006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970826-4f10-44b8-a140-6c7419848d9b None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.063042 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 495/978] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:33.068734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.069026 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.069309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.087638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:33.088850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:33.160841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 496/979] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:33.162027 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b49793-f3fc-40ea-807e-5201c804d97e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:33.183693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:33.185455 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:33.198622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:33.199335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.199616 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.199887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.200725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:33.201028 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:33.202401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:33.215787 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 484/980] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:33.221244 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:33.319434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12aeb-2b24-4494-83d0-bd87f998eb88 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:33.348324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:33.358282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984f88-ca61-4c8f-a766-10c2b28cf40b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:33.361929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:33.362725 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.363103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.363447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.364250 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:33.365715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:33.386833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 497/981] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:33 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:38:33.421018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:33.422439 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.422731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.423153 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.431472 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:33.433051 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:33.450145 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:33.451205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:33.452159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 485/982] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:33.459222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:33.576701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf2d5-21ab-417a-8263-006ebc054077 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:33.615443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:33.616469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.616982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.617260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.618049 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:33.618357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:33.619842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc002a2-c5af-41bf-b430-b7b27a46ea7a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:33.634734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 498/983] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:33.640597 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:33.685180 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:33.748018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620e49-1375-451c-8553-3b519ae896f4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:33.788183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:33.789283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.789827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.790319 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.791418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] RBAC: Adding query filter params (role.id=1c2efabd2b9a49b6bf9b6489efcc7a37, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=526cc7ffdc3a4af2b47481206e81bb44) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:33.791954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:33.793631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53655c-0c56-4ced-84ec-9ea3d9781651 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:33.801819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 486/984] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:33 2022] GET /identity/v3/role_assignments?user.id=526cc7ffdc3a4af2b47481206e81bb44&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=1c2efabd2b9a49b6bf9b6489efcc7a37 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:33.964510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708795-1123-447a-a88a-cee4beebb5c7 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.964942 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708795-1123-447a-a88a-cee4beebb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.965131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708795-1123-447a-a88a-cee4beebb5c7 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.966804 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 499/985] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:33.973641 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:33.973959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:33.974209 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:33.993519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:33.995197 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:34.076151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 487/986] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:34.101590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c708795-1123-447a-a88a-cee4beebb5c7 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:34.150511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:34.213884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c708795-1123-447a-a88a-cee4beebb5c7 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:34.252220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:34.252815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:34.253104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:34.253383 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:34.254103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:34.255660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:34.258929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: WARNING keystone.server.flask.common [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:38:34.276805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.sql.core [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:38:34.276805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:38:34.276805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [parameters: {'user_id': '52c30f3c9c6842beb821c03f3b18babd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:38:34.276805 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=206999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application conn.query(q) May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result.read() May 19 14:38:34.284274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:38:34.285225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application next(self.gen) May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application yield resource May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application next(self.gen) May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise self.value May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application session.commit() May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:38:34.286234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.session.flush() May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application compat.raise_( May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:38:34.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:38:34.288195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application conn.query(q) May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application result.read() May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:38:34.289099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [parameters: {'user_id': '52c30f3c9c6842beb821c03f3b18babd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:34.290077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 14:38:34.290990 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:34.292104 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 500/987] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:38:34 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:34.292500 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:34.329406 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:34.402102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdd313-fc63-4cfd-ba05-8acbd131ae7b None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:34.439335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:34.440551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:34.441040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:34.441537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:34.449376 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:34.451128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f554dc9f-b33e-4af2-85ea-6118f945ebba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:34.466800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:34.467814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:38:34.468837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:34.471609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 488/988] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:34.477968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:34.581198 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0922414-5b51-46e9-8224-f342234d0aa2 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:34.584055 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:34.618099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:34.618780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:34.619100 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:34.619374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:34.620190 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:34.620495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:34.622180 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fd7fb-16fb-4db3-8f01-38e5f68864fc None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:34.665660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 501/989] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:38:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:35.099794 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1cd4-1f0d-439a-a635-443cea9b2821 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.100316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1cd4-1f0d-439a-a635-443cea9b2821 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.100316 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1cd4-1f0d-439a-a635-443cea9b2821 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.101836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 489/990] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:35.107730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.108155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.108328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.126087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:35.127706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:35.195666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 502/991] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:35.218074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1cd4-1f0d-439a-a635-443cea9b2821 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:35.318111 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:35.329421 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1cd4-1f0d-439a-a635-443cea9b2821 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:35.367563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:35.368338 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.368624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.368899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.369559 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:35.370963 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:35.383407 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:35.384555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:38:35.385482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:35.391009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 490/992] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:38:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:35.391490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:35.484030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:35.494032 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b6f8-6504-4426-b7bd-19ca422b244e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:35.528938 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:35.529600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.529885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.530154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.530884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:35.531751 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:35.533127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:35.543001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 503/993] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:35.543937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:35.644791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6359a-d5e6-40f8-985d-5d2e778e245d None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:35.678525 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:35.679250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.679535 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.679812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.680545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:35.680853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:35.682297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2bf6-3bff-4fbf-9947-74f7c1cfa6c9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:35.688415 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 491/994] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:38:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:35.694312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:35.796945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110424c-e22b-486f-9c5b-b67bcb59691f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:35.831760 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee25c2-35ae-45e0-9c3a-7f4e64e83453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:35.832416 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee25c2-35ae-45e0-9c3a-7f4e64e83453 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.832696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee25c2-35ae-45e0-9c3a-7f4e64e83453 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.832965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee25c2-35ae-45e0-9c3a-7f4e64e83453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.833698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee25c2-35ae-45e0-9c3a-7f4e64e83453 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:35.835101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee25c2-35ae-45e0-9c3a-7f4e64e83453 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:35.851239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 504/995] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:35.871687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060505f-5dc7-44a3-b531-f4cc79913eeb None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.872015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060505f-5dc7-44a3-b531-f4cc79913eeb None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.872266 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060505f-5dc7-44a3-b531-f4cc79913eeb None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.873910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 492/996] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:35.880274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d3bc-6cd9-4e68-ab4b-7a13e3f476ff None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:35.880600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d3bc-6cd9-4e68-ab4b-7a13e3f476ff None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:35.880847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d3bc-6cd9-4e68-ab4b-7a13e3f476ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:35.899983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-fed5d3bc-6cd9-4e68-ab4b-7a13e3f476ff None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:35.901181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-fed5d3bc-6cd9-4e68-ab4b-7a13e3f476ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:35.917827 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:35.993243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 505/997] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:36.020128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060505f-5dc7-44a3-b531-f4cc79913eeb None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.046950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:36.134910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060505f-5dc7-44a3-b531-f4cc79913eeb None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.163933 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3177b1-3e48-4732-8c84-7297d33f2937 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.164462 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3177b1-3e48-4732-8c84-7297d33f2937 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.164462 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3177b1-3e48-4732-8c84-7297d33f2937 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.165969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 506/998] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:36.169718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.170521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.170704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.170827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.171035 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.171159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] PATH_INFO: `/v3/services/compute` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.171329 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.172246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.173652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:36.186508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:36.188281 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:36.189188 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 493/999] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:36.191272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:36.192482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:36.194397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.276843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 507/1000] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:36.293168 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:36.299932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.311471 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7891b88-cbaa-4448-9fe2-c77726994ccf None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.347837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.348499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.348780 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.349053 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.349858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:36.350280 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.351726 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.362391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 494/1001] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:36.363613 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.378108 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:36.412516 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ecae-5c16-475d-bad5-a8c6137ea592 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.449517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.450310 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.450590 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.450890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] PATH_INFO: `/v3/services/image` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.451539 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.452899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:36.466885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:36.467993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:36.468903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 508/1002] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:36.474162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.490071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a816-ee05-456c-a8e6-cbd87cfeada9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.526570 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.527284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.527555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.527953 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.528711 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] RBAC: Adding query filter params (type=compute) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:36.529017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.530526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.536319 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 495/1003] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:36.542101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.557658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:36.578968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1efc60-79c3-4359-a937-a793c6f26e25 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.613670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.614325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.614611 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.614913 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.615617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] RBAC: Adding query filter params (name=image) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:36.615916 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.617373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.619163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:36.627363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 509/1004] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:36.628655 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.663448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab023d5-afd5-4baf-85ea-f0433b5ea80a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.700392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.701659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.701659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.701659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.702305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] RBAC: Adding query filter params (interface=public, service_id=97d0ff81bdd243dab53f6ce17bc496d0, region_id=RegionOne) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:36.702618 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.704082 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.709937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 496/1005] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/endpoints?service_id=97d0ff81bdd243dab53f6ce17bc496d0&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:36.715340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:36.733497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fb425-0416-46db-ac6b-2f37571f2d9d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.769554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.770218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.770507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.770799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.771510 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] RBAC: Adding query filter params (type=image) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:36.772061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.773210 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc48a-85ea-49b5-ad57-d2bc7b566868 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.778884 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 510/1006] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:36.803861 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:36.830529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d6b17-7fc6-4180-9efe-737af820b428 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:36.869660 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d1376-8415-4268-a799-4a2a6dfcc3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:36.870727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1376-8415-4268-a799-4a2a6dfcc3f4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:36.871274 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1376-8415-4268-a799-4a2a6dfcc3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:36.871757 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1376-8415-4268-a799-4a2a6dfcc3f4 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:36.872687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d1376-8415-4268-a799-4a2a6dfcc3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:36.874283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d1376-8415-4268-a799-4a2a6dfcc3f4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:36.881568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 497/1007] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:36 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:38:38.149108 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee89fe-7b91-4c9a-a843-092ff6c455b9 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:38.149696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee89fe-7b91-4c9a-a843-092ff6c455b9 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:38.149696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee89fe-7b91-4c9a-a843-092ff6c455b9 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:38.151256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 511/1008] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:38.156883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:38.157327 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:38.157479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:38.175727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:38.176941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:38.245999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 498/1009] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:38.270195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee89fe-7b91-4c9a-a843-092ff6c455b9 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:38.335762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:38.377632 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee89fe-7b91-4c9a-a843-092ff6c455b9 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:38.411146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9f457-73de-475c-8ffe-8d5d1adba3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:38.411862 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f457-73de-475c-8ffe-8d5d1adba3d4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:38.412151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f457-73de-475c-8ffe-8d5d1adba3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:38.412428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f457-73de-475c-8ffe-8d5d1adba3d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:38.413618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f457-73de-475c-8ffe-8d5d1adba3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:38.415097 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f457-73de-475c-8ffe-8d5d1adba3d4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:38.419153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 512/1010] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:38.423002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:38.494996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:38.526913 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885456a3-1d0f-42a4-aac4-9ed4d77c7bfe None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:38.560858 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bd33d-d4b8-45b9-bc1c-2e7ed1a0d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:38.561513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bd33d-d4b8-45b9-bc1c-2e7ed1a0d6b4 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:38.561792 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bd33d-d4b8-45b9-bc1c-2e7ed1a0d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:38.562064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bd33d-d4b8-45b9-bc1c-2e7ed1a0d6b4 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:38.563496 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648bd33d-d4b8-45b9-bc1c-2e7ed1a0d6b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:38.564935 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648bd33d-d4b8-45b9-bc1c-2e7ed1a0d6b4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:38.598821 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 499/1011] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:38 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:39.009545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab863-810e-475e-bdb5-f04a925aff0d None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.009897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab863-810e-475e-bdb5-f04a925aff0d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.010110 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab863-810e-475e-bdb5-f04a925aff0d None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.011670 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 513/1012] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:39.017306 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9506bd-944b-4f6c-b91e-723536bb8dd3 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.017600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9506bd-944b-4f6c-b91e-723536bb8dd3 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.017880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9506bd-944b-4f6c-b91e-723536bb8dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.034663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-2f9506bd-944b-4f6c-b91e-723536bb8dd3 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:39.035871 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-2f9506bd-944b-4f6c-b91e-723536bb8dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:39.107984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 500/1013] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:39.131093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab863-810e-475e-bdb5-f04a925aff0d None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:39.166481 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a420-8a1c-459b-9df2-354b3639d1b7 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.167064 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a420-8a1c-459b-9df2-354b3639d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.167210 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a420-8a1c-459b-9df2-354b3639d1b7 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.168775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 501/1014] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:39.174190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.174484 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.174763 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.192434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:39.193622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:39.241370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:39.242908 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab863-810e-475e-bdb5-f04a925aff0d None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:39.263529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 502/1015] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:39.277638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:39.283203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:39.283868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.284150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.284422 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.285150 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:39.285940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:39.286517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:39.302248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 514/1016] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:38:39 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:39.399614 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7fa54-fb2e-48f7-a214-6f22b4f65da8 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:39.443479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:39.444318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.444608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.444886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] PATH_INFO: `/v3/services/compute` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.445564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:39.446994 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:39.459765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:39.460941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:38:39.461891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:39.467760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 503/1017] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:39.467945 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:39.577609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117120-c98b-4a03-b0c1-43cd045640ac None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:39.612634 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:39.613300 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.613584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.613862 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.614568 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:39.614905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:39.616291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:39.621610 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 515/1018] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:39.627114 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:39.670578 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:39.729078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2f02-1a29-48bd-85db-0056bb9f5860 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:39.763027 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:39.763691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.763978 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.764257 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.764959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:39.765267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:39.766684 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416cd1-cfc8-48ff-b472-50e3483efeb4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:39.776944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 504/1019] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:38:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:39.778390 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:39.839279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:39.888004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5920a2-63d5-4779-a341-e3afefb0f6f8 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:39.924836 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f4da-c76f-427a-a748-45d722fcf52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:39.925563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f4da-c76f-427a-a748-45d722fcf52d None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:39.925852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f4da-c76f-427a-a748-45d722fcf52d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:39.926133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f4da-c76f-427a-a748-45d722fcf52d None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:39.926962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f4da-c76f-427a-a748-45d722fcf52d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:39.928337 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f4da-c76f-427a-a748-45d722fcf52d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:39.954829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 516/1020] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:40.917442 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb33d-7195-48a1-adad-344d80dbde5d None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:40.918010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb33d-7195-48a1-adad-344d80dbde5d None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:40.918010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb33d-7195-48a1-adad-344d80dbde5d None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:40.919693 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 505/1021] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:40.925818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:40.926295 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:40.926378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:40.943696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:40.944899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:41.021597 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 517/1022] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:41.046392 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eb33d-7195-48a1-adad-344d80dbde5d None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:41.150940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eb33d-7195-48a1-adad-344d80dbde5d None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:41.158846 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:41.192016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af442f-1981-4def-a243-a0d7a5c90801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:41.192824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af442f-1981-4def-a243-a0d7a5c90801 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:41.193102 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af442f-1981-4def-a243-a0d7a5c90801 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:41.193371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af442f-1981-4def-a243-a0d7a5c90801 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:41.194598 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af442f-1981-4def-a243-a0d7a5c90801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:41.196070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af442f-1981-4def-a243-a0d7a5c90801 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:41.197892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 506/1023] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:41.203687 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:41.244704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:41.317243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eadff0-46a3-48ad-9403-48f67b819d8e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:41.353035 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ce0c-5c03-4dc8-8bca-d83e5d2ae1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:41.353712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ce0c-5c03-4dc8-8bca-d83e5d2ae1ed None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:41.353999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ce0c-5c03-4dc8-8bca-d83e5d2ae1ed None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:41.354272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ce0c-5c03-4dc8-8bca-d83e5d2ae1ed None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:41.355022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690ce0c-5c03-4dc8-8bca-d83e5d2ae1ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:41.356468 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690ce0c-5c03-4dc8-8bca-d83e5d2ae1ed None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:41.381637 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 518/1024] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:38:41 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:41.590892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53779130-7a5c-49a1-a7d2-8d9ff332fd1e None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:41.591252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53779130-7a5c-49a1-a7d2-8d9ff332fd1e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:41.591610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53779130-7a5c-49a1-a7d2-8d9ff332fd1e None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:41.594463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 507/1025] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:41.600459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:41.600753 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:41.601034 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:41.622297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:41.624244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:41.703360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 519/1026] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:41.725918 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53779130-7a5c-49a1-a7d2-8d9ff332fd1e None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:41.831072 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53779130-7a5c-49a1-a7d2-8d9ff332fd1e None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:41.865690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:41.866459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:41.866748 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:41.867088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] PATH_INFO: `/v3/services/image` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:41.867750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:41.869180 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:41.881639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:41.882734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:41.888848 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 508/1027] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:38:41 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:41.889764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:41.914495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:41.992675 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d10a-2691-476f-a67e-365775465bf4 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:42.033677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:42.034357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.034643 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.034969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.035687 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] RBAC: Adding query filter params (name=image) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:42.035998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:42.037485 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:42.047272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 520/1028] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:42.048219 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:42.089165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:42.156536 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f15271-77f4-4d28-b344-4c7c85e6ee49 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:42.191014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:42.191704 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.191993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.192271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.193069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] RBAC: Adding query filter params (type=image) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:42.193379 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:42.194886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:42.205714 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 509/1029] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:42.207138 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:42.308162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:42.321826 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139845a3-9539-4083-bb30-a82413fa8c54 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:42.356355 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:42.357023 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.357578 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.357854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.358649 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] RBAC: Adding query filter params (interface=public, service_id=cd1fb555156941f6943c57c8a2f75df5, region_id=RegionOne) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:42.358995 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:42.360911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514e1d-4861-41eb-8c07-658e8664a0f3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:42.370683 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 521/1030] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:38:42 2022] GET /identity/v3/endpoints?service_id=cd1fb555156941f6943c57c8a2f75df5&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:42.371670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:42.387451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60327bfd-27ec-4aeb-9662-838370ac44d6 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.387698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60327bfd-27ec-4aeb-9662-838370ac44d6 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.387982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60327bfd-27ec-4aeb-9662-838370ac44d6 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.389502 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 522/1031] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:42.394408 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.394708 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.395020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.412936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:42.414085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:42.475739 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1923ea6-9812-4d6e-bc05-707091249660 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:42.477425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:42.490859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 523/1032] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:42.514139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:42.514834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.515267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.515484 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.515897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:42.516185 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:42.517606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:42.524703 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 510/1033] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:38:42 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:38:42.613208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:42.634543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef629a-fa1c-4b66-b3ab-c9d252e973da None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:42.674753 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:42.675919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.676392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.676850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.688577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:42.697563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:42.698636 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:42.699595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:42.703508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 524/1034] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:38:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:42.707923 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:42.811964 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff2ad-cb76-4b41-ae64-ee6af69ece90 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:42.846310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:42.847021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:42.847312 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:42.847593 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:42.848351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:42.848663 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:42.850047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:42.866865 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 511/1035] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:38:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:42.872761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:42.992788 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478524a-6cbb-4129-bc1a-25eef575bd90 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:43.029076 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:43.029881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:43.030162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:43.030434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:43.044425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:43.045904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:43.049698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:43.067038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:43.068078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:43.069349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:43.069349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:43.069349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:43.069349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:43.069349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 525/1036] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:43.073870 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:43.106496 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:43.181112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36963-d758-4b55-8cc4-3188529032b6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:43.214986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:43.215930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:43.216393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:43.216826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:43.217706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:43.218166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:43.220304 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:43.237247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 512/1037] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:43.239455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:43.354606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c60433-bf9c-498d-9625-6729081f25d3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:43.388771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:43.389570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:43.389854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:43.390131 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:43.398577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:43.400078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:43.414087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:43.415368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:43.416413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:43.417524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 526/1038] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:38:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:43.421183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:43.511606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:43.526300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7cd73-e617-4ed9-a386-480fcd943fee None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:43.560239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:43.560906 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:43.561190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:43.561463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:43.562857 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:43.563170 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:43.564603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:43.584492 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 513/1039] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:38:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:43.589922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:43.649001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:43.699918 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71718ef4-5e34-476d-b9b7-827eb6af6775 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:43.736571 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefce9-6150-4c60-acc1-31a2d95ea0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:43.737226 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefce9-6150-4c60-acc1-31a2d95ea0db None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:43.737507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefce9-6150-4c60-acc1-31a2d95ea0db None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:43.737780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefce9-6150-4c60-acc1-31a2d95ea0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:43.807594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefce9-6150-4c60-acc1-31a2d95ea0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:43.808997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefce9-6150-4c60-acc1-31a2d95ea0db None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:43.871360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:43.950854 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 527/1040] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:38:43.952814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.060465 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f2b64-e55c-4b11-9e5f-92d3167576bc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.095583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.097138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.097629 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.098094 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.105218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d0c3-6f3f-408d-8573-10322e5a64d3 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.105706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d0c3-6f3f-408d-8573-10322e5a64d3 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.105797 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d0c3-6f3f-408d-8573-10322e5a64d3 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.107443 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 528/1041] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:44.110545 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.112235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.113135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.113427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.113716 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.120521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:44.131918 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:44.132204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:44.133239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:44.139384 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:44.139384 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:44.139384 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:44.139384 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:44.139749 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:44.139840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 514/1042] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:44.139840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.225496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 529/1043] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:44.249743 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.260754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd84f9-7727-4b3c-86be-7af81b66f60f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.298192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.298948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.299231 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.299501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.300235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:44.300538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.301910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.315189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 515/1044] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:44.320866 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.356836 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:44.374849 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbf2e-dbe8-4138-90d8-a5bee422bcfb None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.394552 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:44.413487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.414315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.414595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.414899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.426694 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:44.434328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:44.435596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:44.436723 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:44.440430 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 530/1045] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:44.441620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.446218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c1693-6f6b-4a64-8e91-e7a2ce9ec795 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.483887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.484738 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.485017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.485400 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.492678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.494126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:44.509435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:44.510451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:44.511495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 516/1046] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:44.516836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.547057 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a0dc-f6c9-449a-8551-a59746bae7ff None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.590957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.591390 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.591681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.591963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.592750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:44.593063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.595187 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.610482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 531/1047] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:44.611800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.621730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:44.648839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40940-7a80-4317-857d-4bafba8fd514 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.666958 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:44.692026 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.693078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.693473 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.693855 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.695048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:44.695621 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.697872 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.722063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 517/1048] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:44.723212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.733054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343f75b-bf18-4e5d-b11b-f1714004ece3 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.772579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7a222-7ed3-4f8c-a8a7-b8c9cbbde79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.774171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a222-7ed3-4f8c-a8a7-b8c9cbbde79a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.774988 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a222-7ed3-4f8c-a8a7-b8c9cbbde79a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.775492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a222-7ed3-4f8c-a8a7-b8c9cbbde79a None admin] PATH_INFO: `/v3/users/579f705ad6d54fd8bef1edbe0dbb9d3a` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.794897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7a222-7ed3-4f8c-a8a7-b8c9cbbde79a None admin] RBAC: Authorizing `identity:get_user(user_id=579f705ad6d54fd8bef1edbe0dbb9d3a)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.796450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7a222-7ed3-4f8c-a8a7-b8c9cbbde79a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.798394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 532/1049] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/users/579f705ad6d54fd8bef1edbe0dbb9d3a => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:44.799529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959efe-a5e4-4392-87e7-0983d36fcc34 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.799814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959efe-a5e4-4392-87e7-0983d36fcc34 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.800090 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959efe-a5e4-4392-87e7-0983d36fcc34 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.801317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 533/1050] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:44.803843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959efe-a5e4-4392-87e7-0983d36fcc34 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:44.835929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2fb6-0b08-4e0b-97ec-2f8c4e5ca17b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.866660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:44.869551 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.870248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.870563 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.870832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.871642 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] RBAC: Adding query filter params (role.id=1c2efabd2b9a49b6bf9b6489efcc7a37, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=d0d0efbde33d4360ad47bd0c7a545edd) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:44.871959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:44.873389 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b5b9d-1022-4988-bfa3-655e38a9610a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:44.879526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 518/1051] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/role_assignments?user.id=d0d0efbde33d4360ad47bd0c7a545edd&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=1c2efabd2b9a49b6bf9b6489efcc7a37 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:44.880725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.881015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.881297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.906034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:44.907342 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:44.913195 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959efe-a5e4-4392-87e7-0983d36fcc34 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:44.955971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:44.956755 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:44.957072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:44.957405 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:44.962719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:45.004489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 519/1052] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:45.029246 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:45.040793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.042413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.119974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:45.149792 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4670ac-1f90-4636-b3ac-a8f222087c13 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:45.170387 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 534/1053] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:38:45.172534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:45.190052 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:45.191034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:45.191318 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:45.191899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] PATH_INFO: `/v3/services/image` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:45.192625 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.194043 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:45.206896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:45.208123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:45.209063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 520/1054] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:38:45 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:45.214406 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:45.259201 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:45.297288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d01a-64fc-40bb-a93a-9956359260a9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:45.333612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:45.334487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:45.335024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:45.335174 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:45.336279 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.337748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.339713 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 535/1055] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:38:45 2022] GET /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:45.344810 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fd3f-8257-433f-a292-cfbf110e2fde None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:45.345531 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:45.378581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:45.389174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:45.390308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:45.390827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:45.391426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:45.392348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] RBAC: Adding query filter params (name=image) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:45.392868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.394678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.402825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 521/1056] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:45.406508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:45.452061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee469d0-0cb7-4ad7-8f15-1fe8760c6600 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:45.488664 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:45.489674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:45.489961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:45.490559 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:45.491429 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d, user.id=579f705ad6d54fd8bef1edbe0dbb9d3a) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:45.491746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.493299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.499248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 536/1057] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:45 2022] GET /identity/v3/role_assignments?user.id=579f705ad6d54fd8bef1edbe0dbb9d3a&scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:45.514361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:45.518209 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15298b5-4306-4f2b-86b3-a0fd741d5385 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:45.557706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:45.558393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:45.558675 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:45.558983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:45.559710 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:45.560015 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.561428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a5fd0-caa5-432e-938f-4fce9ff156f3 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.567639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 522/1058] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:45.573227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:45.677834 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:45.686480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd87b64-156b-4d10-a2e6-38250545545e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:45.722937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff433e9e-b6d5-4d0e-bb76-0f345eda9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:45.723607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff433e9e-b6d5-4d0e-bb76-0f345eda9e72 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:45.723894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff433e9e-b6d5-4d0e-bb76-0f345eda9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:45.724170 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff433e9e-b6d5-4d0e-bb76-0f345eda9e72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:45.724928 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff433e9e-b6d5-4d0e-bb76-0f345eda9e72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:45.726318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff433e9e-b6d5-4d0e-bb76-0f345eda9e72 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:45.747220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 537/1059] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:38:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:38:47.155339 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e94f-ec2f-47c1-b667-06d24f78a0c0 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.155906 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e94f-ec2f-47c1-b667-06d24f78a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.155906 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e94f-ec2f-47c1-b667-06d24f78a0c0 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.157441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 523/1060] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:47.162575 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.163123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.163272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.180502 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:47.181684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:47.261106 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 538/1061] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:47.283816 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e94f-ec2f-47c1-b667-06d24f78a0c0 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:47.401640 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e94f-ec2f-47c1-b667-06d24f78a0c0 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:47.448126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:47.448945 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.449227 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.449502 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.459942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:47.468018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:47.469023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:47.469934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:47.474122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 524/1062] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:38:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:47.475428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:47.557288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:47.583421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e0633-9722-4557-aaf0-4718cd7b0ded None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:47.623078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:47.623754 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.624038 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.624314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.625644 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:47.625950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:47.627373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309704d-2b3e-4f66-a859-a4d4b096a57e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:47.640323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 539/1063] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:38:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:47.641918 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:47.668448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:47.750283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec171351-e1ec-4b9d-a881-8cf5549ee72c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:47.771578 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00aad0-8761-4e43-82b9-2ca7e560fac4 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.771875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00aad0-8761-4e43-82b9-2ca7e560fac4 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.772159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00aad0-8761-4e43-82b9-2ca7e560fac4 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.773727 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 540/1064] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:47.778512 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.778832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.779122 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.786997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:47.787794 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.788079 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.788354 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.796527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:47.798706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:47.801103 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:47.802572 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:47.826191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:47.827287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:47.828546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:47.828546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:47.828546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:47.828546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:47.828546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 525/1065] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:47.833294 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:47.876551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 541/1066] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:47.899447 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:47.924622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:47.949249 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2e3c-be55-4dac-a98b-2de86337a27c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:47.978758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:47.988490 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:47.989733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:47.990023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:47.990296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:47.991070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:47.991382 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:47.992753 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.005485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 526/1067] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:48.010680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.012508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfd4f-04a3-4ed3-96bb-7978d0349968 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.051378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cc159-a77b-4545-8948-54fa72af9305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.052173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cc159-a77b-4545-8948-54fa72af9305 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.052460 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cc159-a77b-4545-8948-54fa72af9305 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.052735 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cc159-a77b-4545-8948-54fa72af9305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.064845 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cc159-a77b-4545-8948-54fa72af9305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-a56cc159-a77b-4545-8948-54fa72af9305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:48.073349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:48.074493 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:48.075914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 542/1068] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:48.080217 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615af1cf-9625-40dd-8855-4b34753c65d7 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.080515 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615af1cf-9625-40dd-8855-4b34753c65d7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.080791 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615af1cf-9625-40dd-8855-4b34753c65d7 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.082133 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 543/1069] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:48.083816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615af1cf-9625-40dd-8855-4b34753c65d7 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.117713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0f428-9458-4252-8308-b7e9253f8ef6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.153074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.153866 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.154151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.154423 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.157262 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.162454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.163962 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-56776986-8005-4375-8e7b-8de845f09d4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:48.178683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:48.179894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 527/1070] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:48.181110 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.181886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.181886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.192307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615af1cf-9625-40dd-8855-4b34753c65d7 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.197892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:48.199128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:48.225107 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.231600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.232565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.232849 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.233125 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.233877 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:48.234686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.236109 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.244772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 544/1071] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:48.245563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.269204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 528/1072] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:48.271682 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.350563 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5a872-d81f-490d-9469-8286ea2d785a None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.371048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d32576-67f8-4e17-8327-2c7bdfb76144 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.386264 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.386959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.387247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.387533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.388367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:48.388674 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.390117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.396340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.405090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.405956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.406235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.406508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] PATH_INFO: `/v3/users/579f705ad6d54fd8bef1edbe0dbb9d3a` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.407397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 545/1073] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:48.407818 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] RBAC: Authorizing `identity:get_user(user_id=579f705ad6d54fd8bef1edbe0dbb9d3a)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.408047 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.409308 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.411095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 529/1074] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/users/579f705ad6d54fd8bef1edbe0dbb9d3a => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:48.412695 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.460376 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.511375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf40634-1de3-479e-9aa1-0822df20f371 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.512062 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b190b-0218-45f5-88f9-7418a3042779 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.544788 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.545002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.545363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.545647 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.545783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.545919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.546067 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.546341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.557494 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.558965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:48.575813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:48.576812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:48.577832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:48.577832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:48.577832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:48.577832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:48.577832 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 530/1075] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:48.578170 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.616220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.617686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.624798 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.665543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.681086 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481232f-61cc-4bd6-9238-101c9f57ada7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.713674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.714513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.714813 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.715091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.716263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.716435 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 546/1076] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:38:48.717263 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.717759 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.720009 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 531/1077] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:48.722977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.824905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb3ca3-5a27-4e68-8a29-49e901bf5aa6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.826391 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede1dfc-15d1-4ce6-876e-a93036c8cfce None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.838094 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.859871 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.860662 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.860947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.861221 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.862096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:48.862829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:48.863126 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:48.863403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:48.864124 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:48.864427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.865806 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.871839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:48.873272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:48.877088 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 547/1078] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:48.877863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.892166 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:48.893589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:48.894968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:48.895946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:48.895946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:48.895946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:48.895946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:48.895946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 532/1079] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:48.895946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:48.983807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712344fe-447f-42fd-8547-a4cd5603bdab None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:48.995120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db8ee-4fb8-4178-9117-4013cb3126c7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:49.016902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:49.017784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:49.018069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:49.018343 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d/users/579f705ad6d54fd8bef1edbe0dbb9d3a/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:49.020346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d, user_id=579f705ad6d54fd8bef1edbe0dbb9d3a, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:49.021902 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:49.028285 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:49.029074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:49.029362 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:49.029709 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:49.035203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 548/1080] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:38:48 2022] PUT /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d/users/579f705ad6d54fd8bef1edbe0dbb9d3a/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:38:49.036093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:49.037096 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:49.038556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:49.053991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:49.055120 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:49.056224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 533/1081] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:49.061419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:49.092569 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:49.142454 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:49.181165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc2eb-63eb-4ab6-9e78-e2e626a80342 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:49.181708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8e151-ee20-4eef-93db-3c0ae30cc425 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:49.223119 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:49.223973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:49.223973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:49.224285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:49.224454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:49.224454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:49.224737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:49.224737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:49.225013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:49.225013 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:49.225291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:49.226762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:49.226948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:49.230748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0250480-6a1a-4d58-855e-163248d79920 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:49.243422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 534/1082] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:49.249255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 549/1083] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:49.251056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:49.347238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:49.365144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4665eb-2b0d-4e43-b7a1-3a87c03a61d1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:49.403031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f357b-4b4e-4e08-977d-5f17c22769c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:49.403946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f357b-4b4e-4e08-977d-5f17c22769c7 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:49.404228 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f357b-4b4e-4e08-977d-5f17c22769c7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:49.404505 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f357b-4b4e-4e08-977d-5f17c22769c7 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/d0d0efbde33d4360ad47bd0c7a545edd/roles/1c2efabd2b9a49b6bf9b6489efcc7a37` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:49.407025 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f357b-4b4e-4e08-977d-5f17c22769c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=d0d0efbde33d4360ad47bd0c7a545edd, role_id=1c2efabd2b9a49b6bf9b6489efcc7a37)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:49.408485 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f357b-4b4e-4e08-977d-5f17c22769c7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:49.430884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 535/1084] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:38:49 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/d0d0efbde33d4360ad47bd0c7a545edd/roles/1c2efabd2b9a49b6bf9b6489efcc7a37 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:38:51.276740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6febc-8dc7-4f63-afd3-ae4e5e969b04 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.277243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6febc-8dc7-4f63-afd3-ae4e5e969b04 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.277353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6febc-8dc7-4f63-afd3-ae4e5e969b04 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.278678 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 550/1085] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:51.284034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.284467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.284596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.301807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:51.303047 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:51.368363 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 536/1086] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:51.392169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6febc-8dc7-4f63-afd3-ae4e5e969b04 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:51.496396 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6febc-8dc7-4f63-afd3-ae4e5e969b04 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:51.524828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:51.530707 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb17c1-ff98-4da1-9237-757585db492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:51.532042 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb17c1-ff98-4da1-9237-757585db492e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.532325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb17c1-ff98-4da1-9237-757585db492e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.532600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb17c1-ff98-4da1-9237-757585db492e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.542779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb17c1-ff98-4da1-9237-757585db492e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-bcbb17c1-ff98-4da1-9237-757585db492e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:51.550919 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:51.552095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:51.553256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 551/1087] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:51.558131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:51.628258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00341c-4112-45bf-ad69-5f39a1f32cc7 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.628544 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00341c-4112-45bf-ad69-5f39a1f32cc7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.628825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00341c-4112-45bf-ad69-5f39a1f32cc7 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.630204 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 552/1088] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:38:51.633653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:51.635288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.635573 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.635852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.653677 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:51.654897 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:51.659600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de94aa-9c87-42b1-8ff2-cdf23b517f6c None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:51.693785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:51.694448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.694731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.695075 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.695840 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:51.696146 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:51.697530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:51.705583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 537/1089] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:51.711296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:51.723072 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 553/1090] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:38:51.747235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:51.809747 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ecbfe-476e-4e20-96c9-ce1e170a6c5f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:51.841868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:51.842728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.842977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e76f-82ed-4f81-b0f6-37bb0913c28a None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:51.843104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.843876 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] PATH_INFO: `/v3/users/579f705ad6d54fd8bef1edbe0dbb9d3a` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.845097 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] RBAC: Authorizing `identity:get_user(user_id=579f705ad6d54fd8bef1edbe0dbb9d3a)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:51.846531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:51.848208 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 538/1091] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:38:51 2022] GET /identity/v3/users/579f705ad6d54fd8bef1edbe0dbb9d3a => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:51.853777 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:51.863434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:51.867244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:51.881778 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:51.882581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.882890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.883164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:51.893607 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:38:51.901686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:51.902937 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:51.904041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 554/1092] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:38:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:51.909378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:51.957313 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630898fc-b36e-44cb-8844-948398bb9a5a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:51.993508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:51.994166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:51.994518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:51.994885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.008980 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4bdca-c12d-4a81-ac12-668782503453 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.043077 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.043740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.044023 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.044297 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.045050 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:52.045359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.046736 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.054666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 555/1093] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:38:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:52.060859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.061880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.063358 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.071155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:52.103835 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:52.161089 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd0886-f68d-44af-b384-5bf8d9612f34 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.165022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 539/1094] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:38:52.170891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.194434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.195321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.195604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.195875 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.207684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.209144 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:52.226490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:52.227638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:52.228631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:52.228631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:52.228631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:52.228631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:52.228631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 556/1095] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:52.233591 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.270236 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd525-8fc0-4966-b32e-faa9900f299b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.279149 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:52.306766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.307647 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.307939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.308212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.309403 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.310924 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.313277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 540/1096] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:52.319063 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:52.339672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80d73-6fa3-4f81-92dd-f710cc3700fa None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.373099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.373758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.374044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.374324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.375598 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:52.375910 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.377291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.388899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 557/1097] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:52.394928 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.416672 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5539f4-68ee-43a8-88bb-f2c6217dbb93 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.449825 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.450474 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.450753 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.451057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.451882 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d, user.id=579f705ad6d54fd8bef1edbe0dbb9d3a) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:52.452189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.454184 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.460069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 541/1098] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/role_assignments?user.id=579f705ad6d54fd8bef1edbe0dbb9d3a&scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:52.496033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d83518-baed-4efc-aef6-09fecbfdb9a9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.533618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.534423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.534707 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.535011 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.543154 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.544654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:38:52.560184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:52.561541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:38:52.568270 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 558/1099] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:52.569053 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.616279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:52.679264 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca301a8-a8b9-49b5-86b1-8db4a0604422 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.713099 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.713775 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.714060 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.714334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.715204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:52.715516 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.716955 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.735028 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 542/1100] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:52.740970 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:52.756920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:52.840750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c2500-ba08-4b65-8f3a-a82fa7ee8fbb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:52.875213 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650006-391d-48ee-a839-79e646711520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:52.875868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650006-391d-48ee-a839-79e646711520 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:52.876153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650006-391d-48ee-a839-79e646711520 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:52.876431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650006-391d-48ee-a839-79e646711520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:52.942120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83650006-391d-48ee-a839-79e646711520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:52.943618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83650006-391d-48ee-a839-79e646711520 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:52.957746 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:53.042177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 559/1101] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:38:53.048839 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:53.140413 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:53.146431 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf6f26-a166-40e5-af07-66776bf4c153 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:53.179891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:53.180668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:53.181011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:53.181283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:53.191172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:53.192608 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:38:53.209538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:53.210514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:53.211517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:38:53.211517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:38:53.211517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:38:53.211517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:53.211517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 543/1102] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:38:53.216477 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650006-391d-48ee-a839-79e646711520 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:53.316283 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650006-391d-48ee-a839-79e646711520 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:53.330745 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:53.350639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:53.351365 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:53.351617 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:53.351894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:53.352609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:53.352914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:53.354316 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:53.366176 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 560/1103] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:53.371834 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:53.468058 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38b71-1173-48ef-9d61-255e3780dcd5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:53.501467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:53.502240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:53.502521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:53.502821 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:53.509347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:53.510804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:38:53.524398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:38:53.525540 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:38:53.526653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 544/1104] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:38:53.531319 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:53.631299 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496c89-bf28-4c0b-a431-b0d9f670cba7 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:53.665185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:53.665852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:53.666137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:53.666415 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:53.667240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:53.667554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:53.669006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311f0a-5cb8-4c3d-83c3-f27d4584bd4d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:53.681697 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 561/1105] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:38:53.688346 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:53.699754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:53.789090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca56ab4-f586-433a-8aa2-4e946811c500 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:53.822070 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884240e2-54ee-438e-afb3-271b775242da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:53.822773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884240e2-54ee-438e-afb3-271b775242da None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:53.823087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884240e2-54ee-438e-afb3-271b775242da None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:53.823370 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884240e2-54ee-438e-afb3-271b775242da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:53.824199 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884240e2-54ee-438e-afb3-271b775242da None admin] RBAC: Adding query filter params (role.id=1c2efabd2b9a49b6bf9b6489efcc7a37, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=d0d0efbde33d4360ad47bd0c7a545edd) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:53.824512 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884240e2-54ee-438e-afb3-271b775242da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:53.825944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884240e2-54ee-438e-afb3-271b775242da None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:53.831925 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 545/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:53 2022] GET /identity/v3/role_assignments?user.id=d0d0efbde33d4360ad47bd0c7a545edd&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=1c2efabd2b9a49b6bf9b6489efcc7a37 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:54.725924 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0acd82-d892-43ec-8b86-6e43d88cc7fd None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:54.726564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0acd82-d892-43ec-8b86-6e43d88cc7fd None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:54.726564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0acd82-d892-43ec-8b86-6e43d88cc7fd None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:54.727880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 562/1107] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:54.733283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:54.733679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:54.733883 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:54.750850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:54.752050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:54.820903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 546/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:54.846117 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0acd82-d892-43ec-8b86-6e43d88cc7fd None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:54.881703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:54.946405 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0acd82-d892-43ec-8b86-6e43d88cc7fd None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:54.978601 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30a83b-7f86-4198-ac37-6e3c48a2fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:54.979348 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30a83b-7f86-4198-ac37-6e3c48a2fa81 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:54.979633 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30a83b-7f86-4198-ac37-6e3c48a2fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:54.979909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30a83b-7f86-4198-ac37-6e3c48a2fa81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:54.981082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30a83b-7f86-4198-ac37-6e3c48a2fa81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:54.982802 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30a83b-7f86-4198-ac37-6e3c48a2fa81 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:54.984958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 563/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:38:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:54.990634 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:54.992796 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:55.103853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba845e0-e197-4de6-8f1c-a3dabee2def9 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:55.140235 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b229e-84e3-4f27-9609-031e639804ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:55.141132 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b229e-84e3-4f27-9609-031e639804ee None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:55.141418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b229e-84e3-4f27-9609-031e639804ee None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:55.141697 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b229e-84e3-4f27-9609-031e639804ee None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:55.142415 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b229e-84e3-4f27-9609-031e639804ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:55.143873 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b229e-84e3-4f27-9609-031e639804ee None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:55.164248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 547/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:38:54 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:38:57.402393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6f700-329a-4d10-a1c2-170632099d70 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:57.402973 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6f700-329a-4d10-a1c2-170632099d70 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:57.402973 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6f700-329a-4d10-a1c2-170632099d70 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:57.404350 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 564/1111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:38:57.410508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:57.410938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:57.411108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:57.427627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:38:57.428843 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:38:57.487886 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:57.502693 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 548/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:38:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:38:57.526837 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6f700-329a-4d10-a1c2-170632099d70 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:57.625768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6f700-329a-4d10-a1c2-170632099d70 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:57.627303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:57.660342 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:57.661182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:57.661465 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:57.661741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] PATH_INFO: `/v3/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:57.663246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] RBAC: Authorizing `identity:get_role(role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:57.664738 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:57.666103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 565/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:38:57 2022] GET /identity/v3/roles/0cebdd5895894be58dd945aadfab5e3f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:57.671954 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:57.768391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa801b-f97a-4fac-8b00-c329e360dc66 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:57.801795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:57.802594 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:57.802907 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:57.803187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] PATH_INFO: `/v3/users/732bbca3b8aa4e078d200746faf33420` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:57.816519 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] RBAC: Authorizing `identity:get_user(user_id=732bbca3b8aa4e078d200746faf33420)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:57.817966 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:57.819642 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 549/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:38:57 2022] GET /identity/v3/users/732bbca3b8aa4e078d200746faf33420 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:57.825496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:57.923811 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f789083-b4ce-46c7-ba56-b88667e04c14 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:57.958216 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:57.958879 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:57.959162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:57.959435 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:57.996982 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:58.024767 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:58.026238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:58.120564 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 566/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:38:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:38:58.126982 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:58.170773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:58.221718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c783-c284-47b5-8f08-1553944865dc None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:58.255700 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f924ae-e170-4227-8f94-9f19981760bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:58.256557 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f924ae-e170-4227-8f94-9f19981760bc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:58.256837 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f924ae-e170-4227-8f94-9f19981760bc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:58.257140 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f924ae-e170-4227-8f94-9f19981760bc None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:58.258329 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f924ae-e170-4227-8f94-9f19981760bc None admin] RBAC: Authorizing `identity:get_project(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:58.259787 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f924ae-e170-4227-8f94-9f19981760bc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:58.261489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 550/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:38:58 2022] GET /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:38:58.267657 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:38:58.333244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:38:58.363939 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd0dec-2715-4084-a9b8-ff58e6717a12 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:38:58.396006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:38:58.396583 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:38:58.396863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:38:58.397137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:38:58.397946 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] RBAC: Adding query filter params (role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d, user.id=732bbca3b8aa4e078d200746faf33420) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:38:58.398253 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:38:58.399701 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75466f-d3fa-4b67-b1f4-2fbd42817b60 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:38:58.404983 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 567/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:38:58 2022] GET /identity/v3/role_assignments?user.id=732bbca3b8aa4e078d200746faf33420&scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:00.645830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f46d9-73f3-41d7-9d4d-4b8af0e35e44 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:00.646360 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f46d9-73f3-41d7-9d4d-4b8af0e35e44 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:00.646360 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f46d9-73f3-41d7-9d4d-4b8af0e35e44 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:00.647793 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 551/1118] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:00.653021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:00.653472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:00.653570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:00.670524 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:00.672421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:00.737313 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 568/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:00.759162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f46d9-73f3-41d7-9d4d-4b8af0e35e44 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:00.856144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f46d9-73f3-41d7-9d4d-4b8af0e35e44 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:00.870116 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:00.889622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:00.891005 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:00.891283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:00.891553 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] PATH_INFO: `/v3/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:00.893022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] RBAC: Authorizing `identity:get_role(role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:00.894377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:00.895749 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 552/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:00 2022] GET /identity/v3/roles/0cebdd5895894be58dd945aadfab5e3f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:00.901513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:00.961816 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:00.998961 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407a53-33c3-4bdd-baa5-2bd842924302 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:01.032291 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:01.033145 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:01.033428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:01.033704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] PATH_INFO: `/v3/users/732bbca3b8aa4e078d200746faf33420` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:01.034915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] RBAC: Authorizing `identity:get_user(user_id=732bbca3b8aa4e078d200746faf33420)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:01.036363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:01.037991 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 569/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:00 2022] GET /identity/v3/users/732bbca3b8aa4e078d200746faf33420 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:01.043655 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:01.141191 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c72ea-1a87-43f4-b119-ebab40c6420e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:01.173426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb111f3-46e8-4891-a414-0e3b6665a8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:01.174216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb111f3-46e8-4891-a414-0e3b6665a8fc None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:01.174496 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb111f3-46e8-4891-a414-0e3b6665a8fc None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:01.174769 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb111f3-46e8-4891-a414-0e3b6665a8fc None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:01.175980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb111f3-46e8-4891-a414-0e3b6665a8fc None admin] RBAC: Authorizing `identity:get_project(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:01.177398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb111f3-46e8-4891-a414-0e3b6665a8fc None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:01.179121 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 553/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:01 2022] GET /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:01.184788 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:01.283192 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbefb5-427e-462c-bb75-0424bc529ffb None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:01.311593 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:01.317301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109577c3-2115-433e-a2cb-c2e690a6f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:01.318187 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109577c3-2115-433e-a2cb-c2e690a6f285 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:01.318471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109577c3-2115-433e-a2cb-c2e690a6f285 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:01.318748 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109577c3-2115-433e-a2cb-c2e690a6f285 None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d/users/732bbca3b8aa4e078d200746faf33420/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:01.320979 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109577c3-2115-433e-a2cb-c2e690a6f285 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d, user_id=732bbca3b8aa4e078d200746faf33420, role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:01.322428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109577c3-2115-433e-a2cb-c2e690a6f285 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:01.335130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 570/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:39:01 2022] PUT /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d/users/732bbca3b8aa4e078d200746faf33420/roles/0cebdd5895894be58dd945aadfab5e3f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:39:03.533740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868288f-0ae3-4924-80b8-ce066fb87155 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:03.534279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868288f-0ae3-4924-80b8-ce066fb87155 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:03.534279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868288f-0ae3-4924-80b8-ce066fb87155 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:03.535628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 554/1124] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:03.540905 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:03.541313 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:03.541463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:03.558413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:03.559616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:03.623455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 571/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:03.646589 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868288f-0ae3-4924-80b8-ce066fb87155 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:03.696765 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:03.747730 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868288f-0ae3-4924-80b8-ce066fb87155 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:03.779867 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:03.781247 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:03.781532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:03.781811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] PATH_INFO: `/v3/roles/0cebdd5895894be58dd945aadfab5e3f` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:03.783335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] RBAC: Authorizing `identity:get_role(role_id=0cebdd5895894be58dd945aadfab5e3f)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:03.784754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:03.786085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 555/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:03 2022] GET /identity/v3/roles/0cebdd5895894be58dd945aadfab5e3f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:03.791894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:03.888244 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f609-4015-49cd-9e44-5dfd6b659193 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:03.910583 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:03.923036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:03.923900 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:03.924183 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:03.924460 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] PATH_INFO: `/v3/users/732bbca3b8aa4e078d200746faf33420` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:03.925644 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=732bbca3b8aa4e078d200746faf33420)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:03.927116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:03.928763 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 572/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:03 2022] GET /identity/v3/users/732bbca3b8aa4e078d200746faf33420 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:03.934416 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:04.032032 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c4f5-6359-4828-be1c-ca5587382f7b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:04.048681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:04.065168 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:04.065805 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:04.066091 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:04.066366 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:04.131517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:04.132989 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:04.227030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 556/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:39:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:39:04.233008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:04.337858 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf8df-6ac3-4c70-bd23-8e5d3239f8a5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:04.371598 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7047d-8471-442c-9dfc-4ab633e828d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:04.372450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7047d-8471-442c-9dfc-4ab633e828d6 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:04.372728 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7047d-8471-442c-9dfc-4ab633e828d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:04.372998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7047d-8471-442c-9dfc-4ab633e828d6 None admin] PATH_INFO: `/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:04.374175 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7047d-8471-442c-9dfc-4ab633e828d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea4c30bd9fd43b7b3b18808ab96c19d)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:04.376160 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7047d-8471-442c-9dfc-4ab633e828d6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:04.377896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 573/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:04 2022] GET /identity/v3/projects/2ea4c30bd9fd43b7b3b18808ab96c19d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:04.384090 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:04.402255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:04.483916 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b67a0-e344-47f5-845a-590bae5b5ecb None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:04.517604 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:04.518248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:04.518528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:04.518815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:04.519646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] RBAC: Adding query filter params (role.id=0cebdd5895894be58dd945aadfab5e3f, scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d, user.id=732bbca3b8aa4e078d200746faf33420) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:04.519952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:04.521435 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be903-9282-4395-a59f-b8caa002c4a2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:04.527144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 557/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:39:04 2022] GET /identity/v3/role_assignments?user.id=732bbca3b8aa4e078d200746faf33420&scope.project.id=2ea4c30bd9fd43b7b3b18808ab96c19d&role.id=0cebdd5895894be58dd945aadfab5e3f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:06.759472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a939-a779-44a2-8351-23f7ce46a752 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:06.760057 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a939-a779-44a2-8351-23f7ce46a752 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:06.760057 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a939-a779-44a2-8351-23f7ce46a752 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:06.761418 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 574/1131] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:06.767163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:06.767637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:06.767758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:06.784774 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:06.785941 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:06.849010 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 558/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:06.872580 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a939-a779-44a2-8351-23f7ce46a752 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:06.931413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:06.973765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a939-a779-44a2-8351-23f7ce46a752 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:07.007543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad794d-977d-4b0c-87d4-02f016982fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:07.008319 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad794d-977d-4b0c-87d4-02f016982fa1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:07.008609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad794d-977d-4b0c-87d4-02f016982fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:07.008883 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad794d-977d-4b0c-87d4-02f016982fa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:07.010111 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad794d-977d-4b0c-87d4-02f016982fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:07.011539 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad794d-977d-4b0c-87d4-02f016982fa1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:07.013162 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 575/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:07.019006 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:07.032939 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:07.117242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e137dd-a0c8-4dec-9475-980c4f59068d None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:07.151245 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70241a06-f95a-448d-8c68-d08d2a68c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:07.151902 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70241a06-f95a-448d-8c68-d08d2a68c466 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:07.152186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70241a06-f95a-448d-8c68-d08d2a68c466 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:07.152459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70241a06-f95a-448d-8c68-d08d2a68c466 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:07.153172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70241a06-f95a-448d-8c68-d08d2a68c466 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:07.154599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70241a06-f95a-448d-8c68-d08d2a68c466 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:07.180566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 559/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:39:07 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:39:09.412651 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d23e3-ba94-482b-aa47-ae9671a5c04a None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:09.413205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d23e3-ba94-482b-aa47-ae9671a5c04a None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:09.413205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d23e3-ba94-482b-aa47-ae9671a5c04a None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:09.414639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 576/1135] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:09.420666 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:09.421638 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:09.421755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:09.438527 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:09.439732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:09.495977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:09.505891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 560/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:09.530080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d23e3-ba94-482b-aa47-ae9671a5c04a None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:09.629331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d23e3-ba94-482b-aa47-ae9671a5c04a None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:09.653492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:09.662962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6444-2fd1-49c0-b70b-b4dad4a35cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:09.663741 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6444-2fd1-49c0-b70b-b4dad4a35cba None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:09.664020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6444-2fd1-49c0-b70b-b4dad4a35cba None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:09.664294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6444-2fd1-49c0-b70b-b4dad4a35cba None admin] PATH_INFO: `/v3/domains/default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:09.665459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6444-2fd1-49c0-b70b-b4dad4a35cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:09.666921 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6444-2fd1-49c0-b70b-b4dad4a35cba None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:09.668521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 577/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:39:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:09.675067 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:09.773505 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6245b5-68c5-47be-96e7-4e261992372a None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:09.807622 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaaca9-4ca6-41d2-97f5-3ff8e031dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:09.808213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaaca9-4ca6-41d2-97f5-3ff8e031dc4f None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:09.808493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaaca9-4ca6-41d2-97f5-3ff8e031dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:09.808764 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaaca9-4ca6-41d2-97f5-3ff8e031dc4f None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:09.809481 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaaca9-4ca6-41d2-97f5-3ff8e031dc4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:09.810929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaaca9-4ca6-41d2-97f5-3ff8e031dc4f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:09.829938 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 561/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:39:09 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:39:12.083314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce998-2400-4c54-9eb2-840c8ccd37fd None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:12.083864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce998-2400-4c54-9eb2-840c8ccd37fd None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:12.083864 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce998-2400-4c54-9eb2-840c8ccd37fd None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:12.085255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 578/1139] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:12.090578 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:12.091057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:12.091164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:12.107927 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:12.109606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:12.154296 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:12.175670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 562/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:12.199431 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce998-2400-4c54-9eb2-840c8ccd37fd None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:12.298773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce998-2400-4c54-9eb2-840c8ccd37fd None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:12.334737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:12.335594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:12.335879 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:12.336153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:12.346629 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:39:12.354426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:12.355618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:39:12.356737 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 579/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:12.362464 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:12.461071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccd9a6-834c-4fc6-8bd6-d953f0808b02 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:12.494903 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:12.495555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:12.495835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:12.496107 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:12.496850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:12.497152 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:12.498506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:12.506955 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 563/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:12.512690 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:12.568876 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:12.614535 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4a3f7-8eec-428c-9526-d25ad7417165 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:12.652051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:12.652920 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:12.653209 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:12.653492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] PATH_INFO: `/v3/users/a00a2a5238604e178805e8c616dcb15d` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:12.667222 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] RBAC: Authorizing `identity:get_user(user_id=a00a2a5238604e178805e8c616dcb15d)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:12.668729 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:12.670403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 580/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:12 2022] GET /identity/v3/users/a00a2a5238604e178805e8c616dcb15d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:12.676182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:12.719398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:12.774733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da85c1-4ba9-4c4f-9de6-d5556e429df1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:12.806576 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:12.807240 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:12.807525 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:12.807799 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:12.873568 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:12.875908 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:12.914509 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:12.970646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 564/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:39:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:39:12.978135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:13.076523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ba2b-1c2e-405c-b5df-14fe1e48179c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:13.089025 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:13.111159 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570747e-44a7-4d8c-9f24-d32b4d5c3581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:13.112018 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570747e-44a7-4d8c-9f24-d32b4d5c3581 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:13.112304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570747e-44a7-4d8c-9f24-d32b4d5c3581 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:13.112579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570747e-44a7-4d8c-9f24-d32b4d5c3581 None admin] PATH_INFO: `/v3/projects/ecc3f4f82496406f830f1a936ae36726` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:13.113756 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570747e-44a7-4d8c-9f24-d32b4d5c3581 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc3f4f82496406f830f1a936ae36726)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:13.115243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570747e-44a7-4d8c-9f24-d32b4d5c3581 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:13.116958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 581/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:12 2022] GET /identity/v3/projects/ecc3f4f82496406f830f1a936ae36726 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:13.123082 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:13.216953 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c648fdf-e6d2-4a8b-aec9-62468f4eddcb None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:13.249944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:13.250577 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:13.250884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:13.251156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:13.251973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=ecc3f4f82496406f830f1a936ae36726, user.id=a00a2a5238604e178805e8c616dcb15d) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:13.252278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:13.253698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c53961-4fd5-4294-b154-44a597c4c3aa None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:13.261784 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 565/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:39:13 2022] GET /identity/v3/role_assignments?user.id=a00a2a5238604e178805e8c616dcb15d&scope.project.id=ecc3f4f82496406f830f1a936ae36726&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:15.438772 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7598-0517-4b06-8f02-29661e846a7f None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:15.439394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7598-0517-4b06-8f02-29661e846a7f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:15.439394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7598-0517-4b06-8f02-29661e846a7f None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:15.440705 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 582/1147] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:15.446036 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:15.446479 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:15.446595 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:15.465798 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:15.471248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:15.472450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:15.538442 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 566/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:39:15.561423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7598-0517-4b06-8f02-29661e846a7f None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:15.659390 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7598-0517-4b06-8f02-29661e846a7f None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:15.692010 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:15.692783 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:15.693063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:15.693336 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:15.703151 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:39:15.710620 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:15.711907 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:39:15.712957 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 583/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:15.718222 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:15.821566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baa343-90cb-42bd-a86b-297b50a9aadb None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:15.854534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:15.855215 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:15.855497 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:15.855770 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:15.856514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:15.856819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:15.859068 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:15.861170 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:15.867493 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 567/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:15.873351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:15.914703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:15.972807 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427a5f-d25f-4fb2-b032-8322355faa57 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:16.009137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:16.009999 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:16.010282 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:16.010555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] PATH_INFO: `/v3/users/a00a2a5238604e178805e8c616dcb15d` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:16.011762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] RBAC: Authorizing `identity:get_user(user_id=a00a2a5238604e178805e8c616dcb15d)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:16.013196 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:16.015423 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 584/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:15 2022] GET /identity/v3/users/a00a2a5238604e178805e8c616dcb15d => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:16.021204 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:16.119968 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3586bba-fe96-40a1-90fe-98e0352875f8 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:16.152880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af242-cb19-4d3f-b65f-b92c9399976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:16.153725 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af242-cb19-4d3f-b65f-b92c9399976d None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:16.154003 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af242-cb19-4d3f-b65f-b92c9399976d None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:16.154272 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af242-cb19-4d3f-b65f-b92c9399976d None admin] PATH_INFO: `/v3/projects/ecc3f4f82496406f830f1a936ae36726` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:16.156048 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af242-cb19-4d3f-b65f-b92c9399976d None admin] RBAC: Authorizing `identity:get_project(project_id=ecc3f4f82496406f830f1a936ae36726)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:16.157463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af242-cb19-4d3f-b65f-b92c9399976d None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:16.159181 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 568/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:16 2022] GET /identity/v3/projects/ecc3f4f82496406f830f1a936ae36726 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:16.165262 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:16.262413 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea188-cc93-4073-b074-d2abb50f38b0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:16.272071 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:16.297410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57115ff4-1954-4a52-be71-64ab2ab3cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:16.298296 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115ff4-1954-4a52-be71-64ab2ab3cb50 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:16.298582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115ff4-1954-4a52-be71-64ab2ab3cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:16.298894 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115ff4-1954-4a52-be71-64ab2ab3cb50 None admin] PATH_INFO: `/v3/projects/ecc3f4f82496406f830f1a936ae36726/users/a00a2a5238604e178805e8c616dcb15d/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:16.300898 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57115ff4-1954-4a52-be71-64ab2ab3cb50 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc3f4f82496406f830f1a936ae36726, user_id=a00a2a5238604e178805e8c616dcb15d, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:16.302346 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57115ff4-1954-4a52-be71-64ab2ab3cb50 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:16.315471 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 585/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:39:16 2022] PUT /identity/v3/projects/ecc3f4f82496406f830f1a936ae36726/users/a00a2a5238604e178805e8c616dcb15d/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:39:18.505268 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ce10-55f5-49fe-bc89-fc05f99cb580 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:18.505833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ce10-55f5-49fe-bc89-fc05f99cb580 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:18.505940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ce10-55f5-49fe-bc89-fc05f99cb580 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:18.507268 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 569/1154] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:18.513093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:18.513498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:18.513663 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:18.532031 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:18.533165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:18.599623 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 586/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:18.622773 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ce10-55f5-49fe-bc89-fc05f99cb580 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:18.690698 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:18.725034 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ce10-55f5-49fe-bc89-fc05f99cb580 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:18.757290 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:18.758057 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:18.758336 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:18.758605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:18.768887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:39:18.776419 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:18.777574 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:39:18.778760 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 570/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:18.783739 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:18.882463 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:18.886555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cac47-c79d-4d6d-ae7e-01ce033c0788 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:18.921634 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:18.922294 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:18.922579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:18.922881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:18.923628 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:18.923936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:18.925332 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:18.933325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 587/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:18.939885 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:19.037644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac7cd2-1fd5-4c9b-8254-92b283035537 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:19.062776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:19.071514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:19.072364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:19.072647 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:19.072919 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] PATH_INFO: `/v3/users/a00a2a5238604e178805e8c616dcb15d` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:19.074100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] RBAC: Authorizing `identity:get_user(user_id=a00a2a5238604e178805e8c616dcb15d)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:19.075581 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:19.077236 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 571/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:18 2022] GET /identity/v3/users/a00a2a5238604e178805e8c616dcb15d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:19.082952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:19.179660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ec0f-707d-4790-9266-a10b0ecb62a4 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:19.212330 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:19.212959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:19.213237 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:19.213508 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:19.240403 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:19.280122 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:19.281595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:19.376146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 588/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:39:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:39:19.381879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:19.477432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f82b2-d4ba-4f82-8d6a-6379162e66e9 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:19.509729 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204d127-6313-4fb3-b1ce-dc8a40cfff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:19.510564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204d127-6313-4fb3-b1ce-dc8a40cfff30 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:19.510868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204d127-6313-4fb3-b1ce-dc8a40cfff30 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:19.511144 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204d127-6313-4fb3-b1ce-dc8a40cfff30 None admin] PATH_INFO: `/v3/projects/ecc3f4f82496406f830f1a936ae36726` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:19.512307 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204d127-6313-4fb3-b1ce-dc8a40cfff30 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc3f4f82496406f830f1a936ae36726)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:19.513722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204d127-6313-4fb3-b1ce-dc8a40cfff30 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:19.516163 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 572/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:19 2022] GET /identity/v3/projects/ecc3f4f82496406f830f1a936ae36726 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:19.522169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:19.579163 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:19.619062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4667b0-54f9-471f-9c73-ffeea378e51f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:19.652696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:19.653272 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:19.653550 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:19.653824 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:19.654639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=ecc3f4f82496406f830f1a936ae36726, user.id=a00a2a5238604e178805e8c616dcb15d) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:19.654977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:19.656459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649390-1651-4727-94f6-7bb3489f74fe None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:19.662146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 589/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:39:19 2022] GET /identity/v3/role_assignments?user.id=a00a2a5238604e178805e8c616dcb15d&scope.project.id=ecc3f4f82496406f830f1a936ae36726&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:21.865905 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150972d9-ab7a-4e56-9045-371507da5a97 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:21.866482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150972d9-ab7a-4e56-9045-371507da5a97 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:21.866482 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150972d9-ab7a-4e56-9045-371507da5a97 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:21.867867 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 573/1162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:21.873135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:21.873581 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:21.873686 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:21.891828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:21.893020 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:21.957934 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 590/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:21.980345 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150972d9-ab7a-4e56-9045-371507da5a97 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:22.041277 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:22.080335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150972d9-ab7a-4e56-9045-371507da5a97 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:22.112983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:22.113611 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:22.113894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:22.114169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:22.178164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:22.179564 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:22.237044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:22.278763 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 574/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:39:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:39:22.285245 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:22.338517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:22.382912 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb73b-ab9f-43d5-8387-e5e4e3abcc66 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:22.416248 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:22.417031 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:22.417316 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:22.417592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:22.424850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:22.426328 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2a43d556-5c78-4ab6-b29f-2d5987b369ba None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:22.440231 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:22.441545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:39:22.442696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 591/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:39:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:22.447548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:22.542166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f03e64-34e3-4dee-ae0c-fbff61e57a1a None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:22.575022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:22.575668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:22.575950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:22.576224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:22.576959 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:22.577267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:22.578635 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50016a62-9152-4273-bed8-8811f816e118 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:22.585687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 575/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:39:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:24.767901 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35526d-cdea-46e0-b515-8ef8c742968d None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:24.768482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35526d-cdea-46e0-b515-8ef8c742968d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:24.768482 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35526d-cdea-46e0-b515-8ef8c742968d None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:24.769842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 592/1167] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:24.775301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930f8cf-4c65-49b6-8d28-6287e1d5f078 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:24.775734 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930f8cf-4c65-49b6-8d28-6287e1d5f078 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:24.775851 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930f8cf-4c65-49b6-8d28-6287e1d5f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:24.792601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-b930f8cf-4c65-49b6-8d28-6287e1d5f078 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:24.793785 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-b930f8cf-4c65-49b6-8d28-6287e1d5f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:24.813713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:24.860011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 576/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:24.882304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35526d-cdea-46e0-b515-8ef8c742968d None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:24.982895 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35526d-cdea-46e0-b515-8ef8c742968d None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:24.996006 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:25.015960 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1e945-d51c-42b5-97b7-8f66d727076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:25.016600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e945-d51c-42b5-97b7-8f66d727076b None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:25.016878 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e945-d51c-42b5-97b7-8f66d727076b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:25.017148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e945-d51c-42b5-97b7-8f66d727076b None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:25.017891 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e945-d51c-42b5-97b7-8f66d727076b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:25.019335 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e945-d51c-42b5-97b7-8f66d727076b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:25.033616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 593/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Thu May 19 14:39:24 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:39:27.286186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca1c3-6897-423c-a8c6-9ccfc489ae4e None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:27.286596 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca1c3-6897-423c-a8c6-9ccfc489ae4e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:27.286741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca1c3-6897-423c-a8c6-9ccfc489ae4e None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:27.288146 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 577/1170] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:27.293324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:27.293711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:27.293898 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:27.311040 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:27.312803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:27.377965 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 594/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:27.401023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca1c3-6897-423c-a8c6-9ccfc489ae4e None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:27.502111 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca1c3-6897-423c-a8c6-9ccfc489ae4e None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:27.535644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37de166-e209-4bc4-87d1-77c44e912f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:27.536462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37de166-e209-4bc4-87d1-77c44e912f5a None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:27.536746 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37de166-e209-4bc4-87d1-77c44e912f5a None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:27.537021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37de166-e209-4bc4-87d1-77c44e912f5a None admin] PATH_INFO: `/v3/domains/be6b7316e9ed4a49b8e6ad55c43a9743` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:27.547987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37de166-e209-4bc4-87d1-77c44e912f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=be6b7316e9ed4a49b8e6ad55c43a9743)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:27.549433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37de166-e209-4bc4-87d1-77c44e912f5a None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:27.551114 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 578/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:39:27 2022] GET /identity/v3/domains/be6b7316e9ed4a49b8e6ad55c43a9743 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:27.556962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:27.654102 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a2f5-93d2-427b-a116-807f9c71726b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:27.656969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:27.689525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb001da-174f-4796-86d0-ca0c19ed30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:27.690175 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb001da-174f-4796-86d0-ca0c19ed30ac None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:27.690459 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb001da-174f-4796-86d0-ca0c19ed30ac None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:27.690734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb001da-174f-4796-86d0-ca0c19ed30ac None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:27.691469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb001da-174f-4796-86d0-ca0c19ed30ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:27.692923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb001da-174f-4796-86d0-ca0c19ed30ac None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:27.716696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 595/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:39:27 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:39:29.973248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86658-52dc-4ff3-bc92-3ff6a6261501 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:29.973794 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86658-52dc-4ff3-bc92-3ff6a6261501 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:29.973794 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86658-52dc-4ff3-bc92-3ff6a6261501 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:29.975182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 579/1174] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:29.980497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1617b-9f91-4523-993f-2755873db536 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:29.980922 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1617b-9f91-4523-993f-2755873db536 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:29.981063 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1617b-9f91-4523-993f-2755873db536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:29.998606 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-05c1617b-9f91-4523-993f-2755873db536 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:29.999833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-05c1617b-9f91-4523-993f-2755873db536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:30.064129 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 596/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:30.088216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86658-52dc-4ff3-bc92-3ff6a6261501 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:30.107218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:30.187976 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86658-52dc-4ff3-bc92-3ff6a6261501 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:30.221085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e985f-b6bf-400e-b197-20fbaead68d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:30.221943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e985f-b6bf-400e-b197-20fbaead68d0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:30.222228 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e985f-b6bf-400e-b197-20fbaead68d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:30.222505 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e985f-b6bf-400e-b197-20fbaead68d0 None admin] PATH_INFO: `/v3/domains/be6b7316e9ed4a49b8e6ad55c43a9743` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:30.223789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e985f-b6bf-400e-b197-20fbaead68d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=be6b7316e9ed4a49b8e6ad55c43a9743)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:30.225162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e985f-b6bf-400e-b197-20fbaead68d0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:30.226778 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 580/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:39:30 2022] GET /identity/v3/domains/be6b7316e9ed4a49b8e6ad55c43a9743 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:30.232672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1617b-9f91-4523-993f-2755873db536 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:30.314747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:30.330523 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1617b-9f91-4523-993f-2755873db536 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:30.363956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f18c6-d3c7-4039-aa4a-cf7071412aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:30.364618 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f18c6-d3c7-4039-aa4a-cf7071412aa8 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:30.364903 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f18c6-d3c7-4039-aa4a-cf7071412aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:30.365177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f18c6-d3c7-4039-aa4a-cf7071412aa8 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:30.365878 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f18c6-d3c7-4039-aa4a-cf7071412aa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:30.367362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f18c6-d3c7-4039-aa4a-cf7071412aa8 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:30.385996 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 597/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:39:30 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:39:32.674123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061192f9-869b-4ace-9485-fbad6395ed52 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:32.674648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061192f9-869b-4ace-9485-fbad6395ed52 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:32.674648 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061192f9-869b-4ace-9485-fbad6395ed52 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:32.676012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 581/1178] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:32.681303 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:32.681700 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:32.681861 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:32.698205 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:32.699412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:32.765548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 598/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:32.789135 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061192f9-869b-4ace-9485-fbad6395ed52 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:32.870863 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:32.887526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061192f9-869b-4ace-9485-fbad6395ed52 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:32.920771 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:32.921542 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:32.921822 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:32.922095 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:32.931947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:39:32.939956 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:32.941123 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:39:32.942399 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 582/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:32.947089 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:33.016323 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:33.044647 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6cf7f-a84d-4e13-b12c-2db81bac850e None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:33.078051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:33.078696 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:33.079008 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:33.079285 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:33.080022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:33.080327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:33.081717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:33.089595 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 599/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:33.095949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:33.191365 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25c77b-723a-4f07-98d7-5627209d72af None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:33.223664 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:33.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:33.224786 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:33.225055 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] PATH_INFO: `/v3/users/bafc9249da024c138e9a5b41c8000ddb` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:33.237900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] RBAC: Authorizing `identity:get_user(user_id=bafc9249da024c138e9a5b41c8000ddb)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:33.239361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:33.240975 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 583/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:33 2022] GET /identity/v3/users/bafc9249da024c138e9a5b41c8000ddb => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:33.246410 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:33.344411 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8694f-7651-4aef-8e1e-aded40d62c8b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:33.376767 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:33.377406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:33.377693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:33.377971 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:33.380609 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:33.443655 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:33.445058 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:33.540852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 600/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:39:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:39:33.546683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:33.549541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:33.643162 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad247-36a0-430b-9f49-3fee7c9012da None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:33.679800 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95fa5-6b1d-48d3-9f2f-443b1f10ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:33.680640 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95fa5-6b1d-48d3-9f2f-443b1f10ac0e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:33.680915 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95fa5-6b1d-48d3-9f2f-443b1f10ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:33.681183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95fa5-6b1d-48d3-9f2f-443b1f10ac0e None admin] PATH_INFO: `/v3/projects/307873b02466433e8e260a4788e2aeaf` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:33.682352 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95fa5-6b1d-48d3-9f2f-443b1f10ac0e None admin] RBAC: Authorizing `identity:get_project(project_id=307873b02466433e8e260a4788e2aeaf)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:33.683802 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95fa5-6b1d-48d3-9f2f-443b1f10ac0e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:33.685484 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 584/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:33 2022] GET /identity/v3/projects/307873b02466433e8e260a4788e2aeaf => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:33.691579 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:33.724529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:33.789896 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2b33-2908-4838-b2d2-c0de169012ca None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:33.822844 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:33.823489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:33.823775 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:33.824054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:33.824873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=307873b02466433e8e260a4788e2aeaf, user.id=bafc9249da024c138e9a5b41c8000ddb) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:33.825186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:33.826635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383307-cab3-4146-9984-48bbca7dca70 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:33.832090 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 601/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:39:33 2022] GET /identity/v3/role_assignments?user.id=bafc9249da024c138e9a5b41c8000ddb&scope.project.id=307873b02466433e8e260a4788e2aeaf&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:36.024221 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2edc23-cd96-4699-93ba-b20a54dd15dc None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.024770 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2edc23-cd96-4699-93ba-b20a54dd15dc None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.024770 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2edc23-cd96-4699-93ba-b20a54dd15dc None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.026165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 585/1186] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:36.031302 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.031758 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.031865 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.048399 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:36.049615 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:36.115513 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 602/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:39:36.137681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2edc23-cd96-4699-93ba-b20a54dd15dc None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:36.206557 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:36.237962 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2edc23-cd96-4699-93ba-b20a54dd15dc None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:36.270856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:36.271645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.271929 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.272206 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.282718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:39:36.290238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:36.291489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:39:36.292610 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 586/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:36.297438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:36.324393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:36.394870 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd42cc-bc48-447c-bdeb-e3bc2a9e8617 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:36.429073 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:36.429728 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.430013 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.430290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.431069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:36.431379 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:36.432770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:36.440740 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 603/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:36.446728 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:36.544159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3353-ab40-41c0-a99e-6d4a8da50c11 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:36.571394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:36.577949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:36.578854 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.579139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.579411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] PATH_INFO: `/v3/users/bafc9249da024c138e9a5b41c8000ddb` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.580599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] RBAC: Authorizing `identity:get_user(user_id=bafc9249da024c138e9a5b41c8000ddb)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:36.582025 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:36.583688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 587/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:36 2022] GET /identity/v3/users/bafc9249da024c138e9a5b41c8000ddb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:36.589295 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:36.678514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:36.688731 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1cfc7-3f63-43ab-9241-b3bcc3acbab0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:36.721317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eddd5-2eb9-43a0-bdb8-0778dcc15a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:36.722168 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eddd5-2eb9-43a0-bdb8-0778dcc15a2d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.722457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eddd5-2eb9-43a0-bdb8-0778dcc15a2d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.722736 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eddd5-2eb9-43a0-bdb8-0778dcc15a2d None admin] PATH_INFO: `/v3/projects/307873b02466433e8e260a4788e2aeaf` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.723950 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eddd5-2eb9-43a0-bdb8-0778dcc15a2d None admin] RBAC: Authorizing `identity:get_project(project_id=307873b02466433e8e260a4788e2aeaf)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:36.725404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eddd5-2eb9-43a0-bdb8-0778dcc15a2d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:36.727155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 604/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:36 2022] GET /identity/v3/projects/307873b02466433e8e260a4788e2aeaf => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:36.733112 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:36.832582 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fd453-1fe3-4a86-b96d-d5772f4979b1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:36.866243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b8ff-13b0-4c36-be79-53dea07006bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:36.867159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b8ff-13b0-4c36-be79-53dea07006bf None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:36.867445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b8ff-13b0-4c36-be79-53dea07006bf None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:36.867720 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b8ff-13b0-4c36-be79-53dea07006bf None admin] PATH_INFO: `/v3/projects/307873b02466433e8e260a4788e2aeaf/users/bafc9249da024c138e9a5b41c8000ddb/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:36.869678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38b8ff-13b0-4c36-be79-53dea07006bf None admin] RBAC: Authorizing `identity:create_grant(project_id=307873b02466433e8e260a4788e2aeaf, user_id=bafc9249da024c138e9a5b41c8000ddb, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:36.871169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38b8ff-13b0-4c36-be79-53dea07006bf None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:36.883588 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 588/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:39:36 2022] PUT /identity/v3/projects/307873b02466433e8e260a4788e2aeaf/users/bafc9249da024c138e9a5b41c8000ddb/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:39:39.067203 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba175-94cc-4a10-9917-10a0c8fbe460 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:39.067801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba175-94cc-4a10-9917-10a0c8fbe460 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:39.067801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba175-94cc-4a10-9917-10a0c8fbe460 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:39.069127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 605/1193] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:39:39.074432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:39.074878 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:39.075023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:39.092539 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:39:39.093717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:39:39.145332 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:39.159414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 589/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:39:39.183099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba175-94cc-4a10-9917-10a0c8fbe460 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:39.282921 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba175-94cc-4a10-9917-10a0c8fbe460 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:39.316110 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:39.316887 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:39.317173 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:39.317498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:39.327815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:39:39.335370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:39:39.336504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:39:39.337469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 606/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:39:39.342520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:39.438099 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396ce9-df96-45bf-9b41-fa9fdd68c465 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:39.470289 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:39.470967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:39.471253 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:39.471529 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:39.472278 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:39.472587 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:39.473955 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:39.481824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 590/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:39.488155 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:39.506964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:39.583795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8efac-c96c-4ba1-a3f8-83d4265dbdf9 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:39.616914 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:39.617759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:39.618040 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:39.618309 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] PATH_INFO: `/v3/users/bafc9249da024c138e9a5b41c8000ddb` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:39.619452 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] RBAC: Authorizing `identity:get_user(user_id=bafc9249da024c138e9a5b41c8000ddb)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:39.620898 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:39.622498 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 607/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:39:39 2022] GET /identity/v3/users/bafc9249da024c138e9a5b41c8000ddb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:39.628041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:39.676639 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:39.725169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993e0f-1ecd-4b80-88d6-3d761687ada2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:39.757884 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:39.758513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:39.758818 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:39.759104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:39.823078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:39.824520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:39.871819 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:39.922899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 591/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:39:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:39:39.928843 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:40.011317 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:40.026252 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c3726-04e1-47b7-acbd-42bebe9ba689 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:40.060378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bad044-3d44-404b-9d98-722e45bebf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:40.061274 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad044-3d44-404b-9d98-722e45bebf90 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:40.061555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad044-3d44-404b-9d98-722e45bebf90 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:40.061827 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad044-3d44-404b-9d98-722e45bebf90 None admin] PATH_INFO: `/v3/projects/307873b02466433e8e260a4788e2aeaf` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:40.063030 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bad044-3d44-404b-9d98-722e45bebf90 None admin] RBAC: Authorizing `identity:get_project(project_id=307873b02466433e8e260a4788e2aeaf)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:40.064480 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bad044-3d44-404b-9d98-722e45bebf90 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:40.066177 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 608/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:39:39 2022] GET /identity/v3/projects/307873b02466433e8e260a4788e2aeaf => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:40.072317 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:39:40.168371 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4bcf-8a0f-4d67-a06a-d25771773815 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:39:40.200644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:39:40.201275 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:39:40.202087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:39:40.202364 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:39:40.203213 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=307873b02466433e8e260a4788e2aeaf, user.id=bafc9249da024c138e9a5b41c8000ddb) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:39:40.203524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:39:40.204947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee0c8-d9cf-48ce-a4a6-c9487e43fd2b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:39:40.210658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 592/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:39:40 2022] GET /identity/v3/role_assignments?user.id=bafc9249da024c138e9a5b41c8000ddb&scope.project.id=307873b02466433e8e260a4788e2aeaf&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:39:50.056275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=23 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:39:50.208035 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=93 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:38.433974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa2fe0-58c0-4600-a8e2-f9f7a0153b95 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:38.434603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa2fe0-58c0-4600-a8e2-f9f7a0153b95 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:38.434603 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa2fe0-58c0-4600-a8e2-f9f7a0153b95 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:38.436167 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 609/1201] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:40:38.441293 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:38.441741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:38.441919 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:38.459499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:40:38.460688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:40:38.533498 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 593/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:40:38.557811 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa2fe0-58c0-4600-a8e2-f9f7a0153b95 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:38.666891 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa2fe0-58c0-4600-a8e2-f9f7a0153b95 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:38.700462 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:38.701255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:38.701540 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:38.701811 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:38.712228 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:38.713703 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:38.733446 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:38.734621 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:38.735722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:38.735722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:38.735722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:38.735722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:38.735722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 610/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:38.740880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:38.858807 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcf5a4-de35-49bf-a497-9cba55b51488 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:38.894499 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:38.901565 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:38.902475 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:38.902822 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:38.903160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:38.904021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:38.904319 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:38.905706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690c07-3e0b-4d6b-b0c3-6aff2da55ff6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:38.924944 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 594/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:38.930859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:39.004976 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:39.072712 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8260-bae4-42af-a1a8-9da415537d2b None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:39.115367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb825e5c-3cda-406b-96bd-c5471521bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:39.115985 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825e5c-3cda-406b-96bd-c5471521bf68 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:39.116273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825e5c-3cda-406b-96bd-c5471521bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:39.116550 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825e5c-3cda-406b-96bd-c5471521bf68 None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:39.117256 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb825e5c-3cda-406b-96bd-c5471521bf68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:39.118724 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb825e5c-3cda-406b-96bd-c5471521bf68 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:39.150850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 611/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:40:38 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:40:41.807454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e7591-49e2-4b85-b9d5-fa4b64a9fcd1 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:41.808042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e7591-49e2-4b85-b9d5-fa4b64a9fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:41.808042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e7591-49e2-4b85-b9d5-fa4b64a9fcd1 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:41.809924 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 595/1206] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:40:41.815683 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:41.816164 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:41.816371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:41.836567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:40:41.838080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:40:41.921112 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 612/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:40:41.947210 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e7591-49e2-4b85-b9d5-fa4b64a9fcd1 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:42.060847 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e7591-49e2-4b85-b9d5-fa4b64a9fcd1 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:42.103853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:42.104665 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:42.104948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:42.105218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:42.124450 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:40:42.134691 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:42.135940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:42.142136 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 596/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:42.143400 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:42.188967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:42.258616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7221dd-fb3e-4537-9b32-e5d6aa7df969 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:42.298087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:42.298936 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:42.299234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:42.299521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:42.300265 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:42.300571 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:42.301951 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:42.311469 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 613/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:42.317701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:42.377979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:42.434152 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311cef3-ad83-4c81-91b7-3038c8f54c26 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:42.472250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:42.473044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:42.473327 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:42.473601 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:42.486224 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:42.488194 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:42.507436 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:42.508887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:42.509930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:42.509930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:42.509930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:42.509930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:42.509930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 597/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:42.515234 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:42.645545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:42.649363 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51433d-89a9-4d1d-b03f-6ea97dd2ba66 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:42.690987 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:42.691657 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:42.691967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:42.692331 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:42.693349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:42.693658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:42.695290 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:42.709594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 614/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:42.716575 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:42.833022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5f25-6b9c-4a72-a8c7-22b51c5fe88e None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:42.834743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:42.872730 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:42.873531 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:42.873843 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:42.874088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] PATH_INFO: `/v3/users/placement` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:42.882823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:42.883012 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:40:42.899242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:42.905830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:42.907192 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 598/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:40:42.908002 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:43.023560 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03069e-a5bf-4ee6-8b3e-cd423c43500e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:43.062599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573f81-b341-423e-9472-ee070710a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:43.063314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573f81-b341-423e-9472-ee070710a09e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:43.063604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573f81-b341-423e-9472-ee070710a09e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:43.063881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573f81-b341-423e-9472-ee070710a09e None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:43.064734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92573f81-b341-423e-9472-ee070710a09e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:43.065051 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92573f81-b341-423e-9472-ee070710a09e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:43.066578 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92573f81-b341-423e-9472-ee070710a09e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:43.089616 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 615/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:40:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:40:43.094177 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:43.229451 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b988b-d63d-47de-b9ee-4291838c8016 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:43.278772 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:43.279580 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:43.279961 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:43.280279 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:43.322615 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:43.381261 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:43.383069 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:43.517528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 599/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:40:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:40:43.525365 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573f81-b341-423e-9472-ee070710a09e None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:43.552325 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:43.656451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573f81-b341-423e-9472-ee070710a09e None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:43.701833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:43.703407 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:43.704070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:43.704230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:43.721500 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:43.723891 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:43.749003 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:43.750247 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:43.751372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:43.751372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:43.751372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:43.751372 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:43.755966 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 616/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:43.757971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:43.829269 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:43.868612 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1eed-2f25-4d78-8364-01aed5f35392 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:43.905453 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:43.906125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:43.906405 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:43.906674 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:43.907434 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:43.907745 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:43.909105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:43.926305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 600/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:43.927362 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:44.016533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:44.053012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b813-a17c-49b8-862c-325298ad0f15 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:44.104527 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:44.105763 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:44.106095 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:44.106632 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:44.114378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:44.115874 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:40:44.132779 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:44.134000 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:44.135428 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:44.138847 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 617/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:44.141205 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:44.259566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895bf66-8e81-48d4-a7e3-31a5689b6748 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:44.286397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:44.299638 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:44.300397 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:44.300690 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:44.300967 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:44.301766 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:44.302236 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:44.303683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2688a-77b8-4e97-ae1d-61f47901296e None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:44.317749 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 601/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:44.323815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:44.441427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac1fa3-7585-4694-8e3d-27ee747185ff None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:44.473137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:44.479964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:44.480658 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:44.480948 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:44.481776 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:44.482666 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=292407edfaf14822b25f069c5e3c98be) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:44.483061 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:44.484509 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b759-7585-45cd-afce-aff67bd3da2d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:44.494075 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 618/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:40:44 2022] GET /identity/v3/role_assignments?user.id=292407edfaf14822b25f069c5e3c98be&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:46.798041 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1d0e2-859c-4a8e-9781-1b02be37f9da None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:46.798624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1d0e2-859c-4a8e-9781-1b02be37f9da None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:46.798624 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1d0e2-859c-4a8e-9781-1b02be37f9da None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:46.800011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 602/1220] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:40:46.805577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:46.806029 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:46.806189 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:46.826678 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:40:46.827986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:40:46.897828 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 619/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:40:46.923763 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1d0e2-859c-4a8e-9781-1b02be37f9da None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:47.038504 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1d0e2-859c-4a8e-9781-1b02be37f9da None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:47.076270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:47.076990 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:47.077275 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:47.077546 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:47.088119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:40:47.096250 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:47.097432 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:47.098804 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 603/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:40:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:47.103562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:47.206472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78869ca9-583e-4652-afbe-c5bc335ece3a None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:47.230750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:47.242865 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:47.243526 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:47.243813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:47.244091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:47.244840 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] RBAC: Adding query filter params (name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:47.245146 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:47.246577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:47.255514 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 620/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:40:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:47.261245 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:47.306983 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:47.366378 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52c3f-f0f0-4cce-aedb-0a53a45052e5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:47.401556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:47.402340 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:47.402621 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:47.402961 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:47.414489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:47.416001 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:47.434441 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:47.435930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:47.437044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:47.437044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:47.437044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:47.437044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:47.437044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 604/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:40:47.441822 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:47.547962 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91523-e93b-4a0d-a0cb-55bb2014c9be None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:47.583477 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:47.584176 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:47.584499 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:47.584782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:47.585529 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:47.585829 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:47.587288 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:47.599952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 621/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:47.605670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:47.708323 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:47.716609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620502a1-8503-4a97-ac0d-ae6557b81069 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:47.755404 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:47.756210 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:47.756501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:47.756779 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:47.765283 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:47.766743 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:40:47.782179 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:47.783899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:47.785166 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 605/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:40:47.789427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:47.839771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:47.896127 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47cc6c-cde1-401a-bfe2-32c0362f5495 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:47.932651 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:47.933351 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:47.933757 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:47.934012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:47.935538 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:47.937373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:47.937488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:47.956969 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 622/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:40:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:40:47.962604 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:48.068018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420a37-882c-4566-8cbb-1f19fde9ca68 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:48.102948 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:48.103739 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:48.104021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:48.104295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:48.116733 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:48.118184 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:48.136671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:48.137896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:48.139182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:48.139182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:48.139182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:48.139182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:48.139182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 606/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:48.143796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:48.253734 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2357c-069c-446d-a86d-8bc0bb4b753c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:48.260833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:48.297522 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:48.298201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:48.298487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:48.298769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:48.299517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:48.299848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:48.301212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:48.313071 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 623/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:48.318717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:48.329836 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:48.427098 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c845-acdb-4bd2-8c86-cf5c703c42ba None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:48.465993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:48.467019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:48.467225 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:48.467445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:48.475462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:48.477108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:40:48.493688 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:48.500741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:48.501812 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 607/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:48.502857 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:48.610385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897164d-2955-45dc-8f96-a54c73282bec None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:48.650780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:48.651489 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:48.651769 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:48.652041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:48.653371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:48.653682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:48.655254 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5efa92-2fdd-406a-84ee-d0ff005295d2 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:48.673589 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 624/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:48.680491 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:48.752196 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:48.788489 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac80425-ce1d-4a2d-b183-9ee1983ae904 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:48.825880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995b23b-c927-4df7-b255-edf5fd47b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:48.826993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b23b-c927-4df7-b255-edf5fd47b2a7 None admin] REQUEST_METHOD: `PUT` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:48.827312 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b23b-c927-4df7-b255-edf5fd47b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:48.827618 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b23b-c927-4df7-b255-edf5fd47b2a7 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/292407edfaf14822b25f069c5e3c98be/roles/80b9145ec52b4d17acf8860256f0ef8e` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:48.842970 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b23b-c927-4df7-b255-edf5fd47b2a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=292407edfaf14822b25f069c5e3c98be, role_id=80b9145ec52b4d17acf8860256f0ef8e)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:48.844425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b23b-c927-4df7-b255-edf5fd47b2a7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:48.857218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 608/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:40:48 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/292407edfaf14822b25f069c5e3c98be/roles/80b9145ec52b4d17acf8860256f0ef8e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:40:51.118269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c66e1-1c21-43e1-a687-9a6d3df9dbf4 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:51.118880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c66e1-1c21-43e1-a687-9a6d3df9dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:51.118880 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c66e1-1c21-43e1-a687-9a6d3df9dbf4 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:51.120235 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 625/1233] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:40:51.125599 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:51.126020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:51.126150 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:51.143534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:40:51.144927 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:40:51.212729 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 609/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:40:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:40:51.239456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c66e1-1c21-43e1-a687-9a6d3df9dbf4 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:51.273367 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:51.354349 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c66e1-1c21-43e1-a687-9a6d3df9dbf4 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:51.393504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:51.394236 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:51.394515 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:51.394810 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:51.405939 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:40:51.413596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:51.415156 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:51.416258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 626/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:40:51.422056 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:51.471126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:51.529965 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b62d-28cc-45fc-8a24-6a46e2186ff9 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:51.572826 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f86016-1074-4827-acde-092b5540e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:51.573494 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86016-1074-4827-acde-092b5540e54c None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:51.573776 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86016-1074-4827-acde-092b5540e54c None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:51.574044 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86016-1074-4827-acde-092b5540e54c None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:51.575414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f86016-1074-4827-acde-092b5540e54c None admin] RBAC: Adding query filter params (name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:51.575719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f86016-1074-4827-acde-092b5540e54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:51.577118 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f86016-1074-4827-acde-092b5540e54c None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:51.586894 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 610/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:51.592899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:51.684770 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:51.707929 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6457-1edf-4356-9cfe-7847a8e3de66 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:51.754565 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:51.755395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:51.755680 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:51.755956 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:51.768717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:51.770207 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:51.789225 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:51.790260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:51.791467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:51.791467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:51.791467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:51.791467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:51.791467 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 627/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:51.796420 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f86016-1074-4827-acde-092b5540e54c None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:51.906971 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f86016-1074-4827-acde-092b5540e54c None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:51.917038 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:51.949461 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:51.950173 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:51.950490 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:51.950899 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:51.951644 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:51.951949 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:51.953715 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:51.969216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 611/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:51.975170 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:52.096478 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059e46a-204c-44ff-b789-d8b9b8e846e0 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:52.140977 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:52.141853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:52.142143 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:52.142417 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:52.145260 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:52.150710 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:52.152406 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:40:52.168997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:52.170451 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:52.171534 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 628/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:52.176341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:52.294537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8683370-275f-411d-a1de-209c542f55a1 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:52.334680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:52.335391 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:52.335673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:52.335946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:52.336770 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:52.337077 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:52.338497 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:52.358542 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 612/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:40:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:52.364662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:52.485592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bf765-e60d-4818-b310-6a86cb517e39 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:52.524093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:52.525022 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:52.525312 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:52.525592 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:52.590662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:52.597796 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:52.599490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:52.703453 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 629/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:40:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:40:52.709802 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:52.740817 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:52.821128 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280623c3-82d2-48f8-9c53-3fcddb8c4822 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:52.858980 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:52.859823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:52.860092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:52.860367 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:52.871071 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:52.872538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:52.891409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:52.892584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:52.893628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:52.893628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:52.893628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:52.893628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:52.893628 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 613/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:52.898585 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:53.006915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:53.014181 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c75795-b35c-498f-a12c-3a9305f95155 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:53.051569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:53.052371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:53.052726 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:53.053041 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:53.053798 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:53.054130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:53.055570 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:53.068868 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 630/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:53.074514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:53.156083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:53.178159 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce6e7-cce0-46b2-9231-7cc8e1e42c71 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:53.216198 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:53.217046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:53.217330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:53.217631 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:53.225411 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:53.226879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:40:53.242467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:53.243636 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:53.245203 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 614/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:53.250315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:53.353491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ab714-5c10-4b9e-8e3c-d0de99bb7a61 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:53.388269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:53.388901 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:53.389179 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:53.389455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:53.390230 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:53.390536 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:53.392023 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc05609-28dc-4f44-9abe-d3e556c35e85 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:53.404517 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 631/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:53.410815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:53.523986 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa707a-8ef1-46e1-bbf9-49cba3eb9d5b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:53.562513 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:53.563220 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:53.563506 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:53.563788 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:53.564627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] RBAC: Adding query filter params (role.id=80b9145ec52b4d17acf8860256f0ef8e, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=292407edfaf14822b25f069c5e3c98be) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:53.564943 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:53.566386 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf18f-5fe4-4d92-95b0-9b917732d5a9 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:53.573273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 615/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:40:53 2022] GET /identity/v3/role_assignments?user.id=292407edfaf14822b25f069c5e3c98be&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=80b9145ec52b4d17acf8860256f0ef8e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:56.218218 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5510-cd2c-4068-b35b-f5117ca3e873 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:56.218839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5510-cd2c-4068-b35b-f5117ca3e873 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:56.218839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5510-cd2c-4068-b35b-f5117ca3e873 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:56.220344 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 632/1247] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:40:56.229019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:56.229019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:56.229019 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:56.234042 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:56.248796 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:40:56.250022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:40:56.331731 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 616/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:40:56.363452 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5510-cd2c-4068-b35b-f5117ca3e873 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:56.384841 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:56.483033 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5510-cd2c-4068-b35b-f5117ca3e873 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:56.520014 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:56.520879 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:56.521165 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:56.521427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:56.534490 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:40:56.542986 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:56.544318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:56.546188 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 633/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:56.550172 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:56.657562 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83988f7-316c-4760-bcff-4cef377ac7af None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:56.689600 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:56.695187 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:56.695888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:56.696169 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:56.696448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:56.697216 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:56.697521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:56.698933 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:56.708732 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 617/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:56.714584 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:56.803024 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:56.827612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf451d4a-5569-4e67-970b-351f5f7a6bc5 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:56.867056 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:56.867856 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:56.868148 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:56.868495 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:56.880424 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:56.881923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:56.901385 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:56.902619 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:56.903904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:56.903904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:56.903904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:56.903904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:56.903904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 634/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:56.909011 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:57.021074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1aef-f987-4d9e-9b81-a4950c85351f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:57.057206 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:57.057795 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:57.058074 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:57.058347 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:57.059678 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:57.059982 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:57.061352 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:57.075673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 618/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:40:57.081464 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:57.205212 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09f4c-7694-430f-a107-eab8e03a3d06 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:57.234273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:57.243168 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:57.244027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:57.244361 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:57.244624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:57.254084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:57.255596 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:40:57.272364 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:57.273833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:40:57.275334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 635/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:57.279646 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:57.341104 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:57.393645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb0e3-9804-4146-be64-ce441f5bd569 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:57.433501 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:57.435100 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:57.435416 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:57.435702 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:57.436920 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:57.437468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:57.439809 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:57.460141 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 619/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:40:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:57.465997 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:57.575086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f553bd-e48f-4d95-b115-852daaa0ef2c None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:57.611719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:57.612360 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:57.612645 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:57.612927 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:57.672273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:57.687479 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:57.689139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:57.801873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 636/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:40:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:40:57.807853 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:57.916348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2f54a-c1ae-46a7-807f-810d8d897ab4 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:57.935298 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:57.961267 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24183454-f295-433f-b515-cba792a65e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:57.962156 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24183454-f295-433f-b515-cba792a65e59 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:57.962520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24183454-f295-433f-b515-cba792a65e59 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:57.962896 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24183454-f295-433f-b515-cba792a65e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:57.980027 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24183454-f295-433f-b515-cba792a65e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:57.982017 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24183454-f295-433f-b515-cba792a65e59 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-24183454-f295-433f-b515-cba792a65e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:40:58.003606 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:58.004957 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:58.006271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:40:58.006271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:40:58.006271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:40:58.006271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:58.006271 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 620/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:58.011305 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:58.113638 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:58.126799 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bf6dd-e379-44d4-a986-abc6ebcedca1 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:58.163412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:58.164087 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:58.164368 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:58.164641 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:58.165371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:58.165675 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:58.167137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:58.179086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 637/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:58.185055 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24183454-f295-433f-b515-cba792a65e59 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:58.293060 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24183454-f295-433f-b515-cba792a65e59 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:58.328315 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:58.329125 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:58.329409 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:58.329683 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:58.337139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:58.338616 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:40:58.353174 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:40:58.354424 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:40:58.355466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 621/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:40:58.360852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:58.471082 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2095c-17dd-494d-8ecd-fa9d942973ca None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:58.506425 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:58.507393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:58.507676 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:58.507952 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] PATH_INFO: `/v3/projects` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:58.508742 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:58.509054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:58.510520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be55dc0-193b-461d-943d-98da213df60e None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:58.523624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 638/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:40:58.529689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:40:58.556259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:40:58.632824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e749-b1b3-4d3c-9d96-54bf5f9dcfdf None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:40:58.668667 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:40:58.669566 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:40:58.669850 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:40:58.670127 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:40:58.670991 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=292407edfaf14822b25f069c5e3c98be) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:40:58.671305 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:40:58.672744 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3721cc-1a30-426d-8b54-6dbacc8e7cec None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:40:58.678357 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 622/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:40:58 2022] GET /identity/v3/role_assignments?user.id=292407edfaf14822b25f069c5e3c98be&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:00.880879 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce96286-11aa-4c91-9a0c-a54137f7de3a None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:00.881487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce96286-11aa-4c91-9a0c-a54137f7de3a None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:00.881487 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce96286-11aa-4c91-9a0c-a54137f7de3a None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:00.882809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 639/1261] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:41:00.887987 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:00.888394 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:00.888554 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:00.905021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:41:00.906202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:41:00.972238 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 623/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:41:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:41:00.999994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce96286-11aa-4c91-9a0c-a54137f7de3a None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:01.013229 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:01.107789 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce96286-11aa-4c91-9a0c-a54137f7de3a None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:01.142318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:01.143070 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:01.143357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:01.143635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:01.153830 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:41:01.161414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:01.162715 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:01.164064 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 640/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:01.169165 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:01.187439 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:01.265262 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da0ba7-8c7b-4dbb-a30e-2a710acf9c32 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:01.299093 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:01.299740 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:01.300021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:01.300292 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] PATH_INFO: `/v3/roles` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:01.301138 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:01.301445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:01.302824 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:01.310597 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 624/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:01.316457 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:01.383103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:01.416593 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf343d2-3fa2-4699-86fa-3ab4a1f79da8 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:01.449941 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:01.450719 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:01.451028 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:01.451301 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:01.461578 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:01.463062 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:41:01.480066 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:01.481915 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:01.483121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:41:01.483121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:41:01.483121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:01.483121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:01.483121 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 641/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:01.487823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:01.565339 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:01.583585 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e636ba-f9ef-4ffd-9718-e6fffa7f7af7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:01.615950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:01.616590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:01.616871 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:01.617146 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:01.617851 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:01.618152 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:01.619528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:01.630952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 625/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:01.636472 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:01.735140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f514-54a3-46a5-ad01-7ce6707ccf7f None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:01.754271 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:01.772085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:01.772974 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:01.773255 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:01.773525 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] PATH_INFO: `/v3/users/placement` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:01.783450 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:01.785988 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:41:01.800543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:01.801800 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:01.802899 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 642/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:41:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:01.807780 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:01.909659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4c279-e86b-494b-9539-b8ea58bd77e2 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:01.941882 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:01.942534 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:01.942845 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:01.943122 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] PATH_INFO: `/v3/users` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:01.943951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:01.944259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:01.945681 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:01.954537 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:01.964658 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 626/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:41:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:01.972275 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:02.075161 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099373f-9794-4a1f-acb9-c45bfdbd3588 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:02.108765 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:02.109573 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:02.109860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:02.110135 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:02.122083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:02.123591 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:41:02.141427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:02.142600 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:02.143911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:41:02.143911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:41:02.143911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:02.143911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:02.143911 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 643/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:02.148475 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:02.245270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc05d1-b245-4b51-9328-93a38bfd5fd7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:02.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:02.280126 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:02.280414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:02.280694 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:02.281412 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:02.281720 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:02.283131 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:02.294287 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 627/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:02.300043 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:02.332130 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:02.401208 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406ab0-5e0d-49b0-8b9c-962eac4a4b45 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:02.435187 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:02.435955 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:02.436240 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:02.436515 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:02.443239 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:02.444730 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:41:02.459660 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:02.460784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:02.461932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 644/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:02.466763 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:02.524105 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:02.565422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00365663-1688-4460-a70a-e62a9c1b3d3f None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:02.597218 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c78c0-b375-4355-94e1-292862338526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:02.597808 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c78c0-b375-4355-94e1-292862338526 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:02.598093 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c78c0-b375-4355-94e1-292862338526 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:02.598372 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c78c0-b375-4355-94e1-292862338526 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:02.599190 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c78c0-b375-4355-94e1-292862338526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:02.599508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c78c0-b375-4355-94e1-292862338526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:02.600933 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c78c0-b375-4355-94e1-292862338526 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:02.613415 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 628/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:02.619418 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:02.708711 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:02.717885 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62ec9-70dc-4ba6-a62b-332636ae836d None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:02.751992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc516ef-0c1a-4cb1-94e1-6c9e2578c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:02.752872 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc516ef-0c1a-4cb1-94e1-6c9e2578c4f6 None admin] REQUEST_METHOD: `PUT` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:02.753157 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc516ef-0c1a-4cb1-94e1-6c9e2578c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:02.753436 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc516ef-0c1a-4cb1-94e1-6c9e2578c4f6 None admin] PATH_INFO: `/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/292407edfaf14822b25f069c5e3c98be/roles/fc4dc04c73324e7f8b2a5dfc378f6174` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:02.755415 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc516ef-0c1a-4cb1-94e1-6c9e2578c4f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=529a5360fb034eec991b1cb4e5c449a7, user_id=292407edfaf14822b25f069c5e3c98be, role_id=fc4dc04c73324e7f8b2a5dfc378f6174)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:02.756860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc516ef-0c1a-4cb1-94e1-6c9e2578c4f6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:02.769016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 645/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:41:02 2022] PUT /identity/v3/projects/529a5360fb034eec991b1cb4e5c449a7/users/292407edfaf14822b25f069c5e3c98be/roles/fc4dc04c73324e7f8b2a5dfc378f6174 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:41:04.968330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224e7eb-1ab7-4cfd-8517-44efdff87e10 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:04.968900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224e7eb-1ab7-4cfd-8517-44efdff87e10 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:04.968900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224e7eb-1ab7-4cfd-8517-44efdff87e10 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:04.970257 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 629/1274] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:41:04.975642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:04.976093 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:04.976199 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:04.992842 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:41:04.994021 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:41:05.058268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 646/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:41:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:41:05.082433 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224e7eb-1ab7-4cfd-8517-44efdff87e10 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:05.186372 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224e7eb-1ab7-4cfd-8517-44efdff87e10 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:05.203530 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:05.220720 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:05.221438 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:05.221723 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:05.221999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:05.232659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:41:05.240230 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:05.241426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:05.242466 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 630/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:05.248375 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:05.328092 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:05.346968 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4415af-41ab-414a-8cd9-9abf685f48c0 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:05.379863 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:05.380511 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:05.380791 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:05.381060 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] PATH_INFO: `/v3/roles` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:05.381793 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:05.382096 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:05.383488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:05.391873 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 647/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:05.397815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:05.495084 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab217b5-c82d-4e33-a96f-4637429c4cf5 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:05.527365 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:05.528717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:05.529002 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:05.529275 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:05.539579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:05.541031 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:41:05.557713 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:05.558946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:05.560186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:41:05.560186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:41:05.560186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:05.560186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:05.560186 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 631/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:41:05.564497 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:05.662278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92083a-1cd3-42ef-9562-e54c1860b010 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:05.693852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:05.694492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:05.694773 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:05.695078 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] PATH_INFO: `/v3/domains` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:05.695790 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:05.696091 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:05.697456 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:05.709321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 648/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:05.714724 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:05.744833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:05.811926 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56cffa-df2c-4c59-aaf2-57339dfe9818 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:05.844459 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:05.845232 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:05.845517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:05.845791 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] PATH_INFO: `/v3/users/placement` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:05.853719 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:05.855178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:41:05.869758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:05.870984 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:05.872202 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 632/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:41:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:05.876572 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:05.880392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:05.979412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fbdf-ea97-4640-b573-3b9fa8951191 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:06.017379 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:06.018054 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:06.018337 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:06.018613 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] PATH_INFO: `/v3/users` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:06.019488 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:06.019794 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:06.021278 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:06.042320 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 649/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:41:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:06.049263 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:06.138721 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:06.148351 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a58563-1c1f-4aa2-9b59-1b4e387fbfba None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:06.181118 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:06.181755 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:06.182039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:06.182314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:06.247518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:06.248973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:06.333373 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:06.343701 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 633/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:41:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:41:06.349461 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:06.410726 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:06.450083 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625457e-df32-40f3-8f1a-9ded4be5cbbe None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:06.483492 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:06.484268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:06.484554 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:06.484833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:06.494654 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:06.496698 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:41:06.514373 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:06.515521 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:06.516881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:41:06.516881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:41:06.516881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:41:06.516881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:06.516881 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 650/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:06.521239 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:06.614687 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212580-f22b-4603-8572-e21c0ab04ba7 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:06.647335 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:06.647974 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:06.648260 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:06.648528 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] PATH_INFO: `/v3/domains` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:06.649234 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:06.649533 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:06.650900 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:06.661751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 634/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:06.667132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:06.764004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe872-a5d2-482f-ae38-814ff919d127 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:06.777762 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:06.797728 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:06.798504 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:06.798808 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:06.799085 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] PATH_INFO: `/v3/projects/service` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:06.805549 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:06.807032 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:41:06.820859 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application with Lock( May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:06.821967 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: ERROR keystone.server.flask.application May 19 14:41:06.823221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 651/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:06.828418 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:06.877659 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:06.926448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3b75-b3f1-4d44-a511-2f17fae32d8b None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:06.959088 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:06.959814 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:06.960168 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:06.960448 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] PATH_INFO: `/v3/projects` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:06.961242 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:06.961550 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:06.963130 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96aeb4-d0a5-40d1-be4a-e17fe4b392c0 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:06.976833 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 635/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:06.984039 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:07.080695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f83885-cbe2-42a6-b677-de37cd28f3be None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:07.114324 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:07.114994 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:07.115276 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:07.115547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:07.116374 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] RBAC: Adding query filter params (role.id=fc4dc04c73324e7f8b2a5dfc378f6174, scope.project.id=529a5360fb034eec991b1cb4e5c449a7, user.id=292407edfaf14822b25f069c5e3c98be) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:07.116681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:07.118116 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d44f8-8324-4364-ab4a-368d09747305 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:07.124398 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 652/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:41:06 2022] GET /identity/v3/role_assignments?user.id=292407edfaf14822b25f069c5e3c98be&scope.project.id=529a5360fb034eec991b1cb4e5c449a7&role.id=fc4dc04c73324e7f8b2a5dfc378f6174 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:09.398377 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c6753-1c93-4ae3-ad9b-aa5f635ed95e None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:09.398999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c6753-1c93-4ae3-ad9b-aa5f635ed95e None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:09.398999 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c6753-1c93-4ae3-ad9b-aa5f635ed95e None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:09.400324 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 636/1288] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:41:09.405984 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:09.406417 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:09.406547 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:09.423182 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:41:09.424380 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:41:09.453684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:09.490241 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 653/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:41:09.513300 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c6753-1c93-4ae3-ad9b-aa5f635ed95e None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:09.612462 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c6753-1c93-4ae3-ad9b-aa5f635ed95e None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:09.623868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:09.647251 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:09.648036 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:09.648325 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:09.648605 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] PATH_INFO: `/v3/services/placement` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:09.649259 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:09.650632 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:09.662341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:09.663856 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:09.665076 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 637/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:41:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:09.669555 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:09.766588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f42c-cae4-4e5c-b744-3ad3967d1d60 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:09.799142 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:09.799786 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:09.800069 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:09.800345 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:09.801123 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] RBAC: Adding query filter params (name=placement) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:09.801426 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:09.802832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd05f2-5695-41ba-a826-f3d8ba216609 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:09.807599 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 654/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:41:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:09.813491 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:09.909887 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b09906-818e-45fd-b730-98ed63066eba None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:09.942508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:09.943164 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:09.943445 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:09.943717 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] PATH_INFO: `/v3/services` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:09.944406 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] RBAC: Adding query filter params (type=placement) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:09.944708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:09.946059 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec3f95-5bee-4739-986b-9a6a7041d7ac None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:09.950467 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 638/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:41:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:12.155932 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42091c8-65d7-47e2-975d-5b8b3b82c145 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:12.156507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42091c8-65d7-47e2-975d-5b8b3b82c145 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:12.156507 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42091c8-65d7-47e2-975d-5b8b3b82c145 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:12.157867 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 655/1293] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:41:12.163119 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61578-c5db-41ff-a758-f112ea287dea None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:12.163508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61578-c5db-41ff-a758-f112ea287dea None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:12.163680 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61578-c5db-41ff-a758-f112ea287dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:12.180682 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-fdd61578-c5db-41ff-a758-f112ea287dea None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:41:12.181859 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-fdd61578-c5db-41ff-a758-f112ea287dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:41:12.210940 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:12.248979 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 639/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:41:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:41:12.271371 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42091c8-65d7-47e2-975d-5b8b3b82c145 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:12.302249 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:12.374052 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42091c8-65d7-47e2-975d-5b8b3b82c145 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:12.406506 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a591-12a9-45b3-ba9b-e8d32c24fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:12.407119 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a591-12a9-45b3-ba9b-e8d32c24fdc6 None admin] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:12.407404 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a591-12a9-45b3-ba9b-e8d32c24fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:12.407679 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a591-12a9-45b3-ba9b-e8d32c24fdc6 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:12.408401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828a591-12a9-45b3-ba9b-e8d32c24fdc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:12.409788 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828a591-12a9-45b3-ba9b-e8d32c24fdc6 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:12.424477 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 656/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:41:12 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:41:14.618486 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2b84-c812-4c06-b542-c51673b6bc9b None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:14.619061 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2b84-c812-4c06-b542-c51673b6bc9b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:14.619061 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2b84-c812-4c06-b542-c51673b6bc9b None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:14.620376 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 640/1296] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:41:14.625750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:14.626153 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:14.626315 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:14.643370 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:41:14.644582 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:41:14.716171 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 657/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:41:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:41:14.738591 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c2b84-c812-4c06-b542-c51673b6bc9b None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:14.849880 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c2b84-c812-4c06-b542-c51673b6bc9b None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:14.883026 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:14.883742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:14.884022 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:14.884292 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] PATH_INFO: `/v3/services/placement` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:14.884942 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:14.886297 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:14.898524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:14.899879 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:14.901085 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 641/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:41:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:14.905940 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:14.923958 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:15.006764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fe5e2-35fb-4a64-b709-bf36ea308288 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:15.040048 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:15.040706 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:15.040992 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:15.041269 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:15.041966 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] RBAC: Adding query filter params (name=placement) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:15.042273 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:15.043722 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:15.048814 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 658/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:41:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:15.054750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:15.086151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:15.152645 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490d158-21f9-4a75-b016-8ba149d256ea None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:15.187520 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:15.188175 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:15.188460 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:15.188737 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:15.189526 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] RBAC: Adding query filter params (interface=public, service_id=60b20ceda2cf4b27a17b70ce792dc553, region_id=RegionOne) {{(pid=206998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:15.189838 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:15.191243 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd28a6b-3219-4e35-b2df-a071405ec501 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:15.196343 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 642/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:41:15 2022] GET /identity/v3/endpoints?service_id=60b20ceda2cf4b27a17b70ce792dc553&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:15.202016 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:15.294202 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:15.313321 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c35bc-2671-4f00-a85b-f1ed945b5298 None admin] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:15.346284 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3c7c5-6fd6-4d24-90b9-2b957d91091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:15.346973 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c7c5-6fd6-4d24-90b9-2b957d91091f None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:15.347261 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c7c5-6fd6-4d24-90b9-2b957d91091f None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:15.347541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c7c5-6fd6-4d24-90b9-2b957d91091f None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:15.348220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3c7c5-6fd6-4d24-90b9-2b957d91091f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:15.349598 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3c7c5-6fd6-4d24-90b9-2b957d91091f None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:15.357339 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 659/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:41:15 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:41:17.570930 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6b91-72c7-4f23-8dee-2dfa4333f15b None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:17.571541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6b91-72c7-4f23-8dee-2dfa4333f15b None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:17.571541 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6b91-72c7-4f23-8dee-2dfa4333f15b None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:17.572783 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 643/1302] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:41:17.578448 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:17.578934 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:17.579042 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:17.596206 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:41:17.597397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:41:17.672001 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 660/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:41:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:41:17.695182 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6b91-72c7-4f23-8dee-2dfa4333f15b None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:17.788282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:17.795557 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6b91-72c7-4f23-8dee-2dfa4333f15b None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:17.828736 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:17.829458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:17.829742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:17.830016 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:17.830671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:17.832139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:41:17.843888 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:41:17.845273 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application with Lock( May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self._enter() May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application return self.creator() May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application created_value = creator( May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: ERROR keystone.server.flask.application May 19 14:41:17.846454 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 644/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:41:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:41:17.851227 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:17.925604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:17.948505 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ea45b-cc66-43ea-b0e8-60f1edc75d2c None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:17.982137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:17.982809 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:17.983101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:17.983378 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] PATH_INFO: `/v3/services` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:17.984086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] RBAC: Adding query filter params (name=placement) {{(pid=206999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:41:17.984392 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:17.985780 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bc8b2-136e-470e-8c36-2a5f273cec19 None admin] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:17.990928 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 661/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:41:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:41:17.997058 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:41:18.094750 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba271d7-7b3b-41b2-9066-fef193e109b6 None admin] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:41:18.128087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c562b-d3fc-44d0-ad96-e806d61d9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e70edefbb144ebbbd97da5f321c823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:41:18.128727 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c562b-d3fc-44d0-ad96-e806d61d9b44 None admin] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:41:18.129008 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c562b-d3fc-44d0-ad96-e806d61d9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:41:18.129282 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c562b-d3fc-44d0-ad96-e806d61d9b44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:41:18.130021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c562b-d3fc-44d0-ad96-e806d61d9b44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:41:18.131414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c562b-d3fc-44d0-ad96-e806d61d9b44 None admin] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:41:18.148891 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 645/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:41:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:41:27.988007 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=30 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:41:28.145024 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:23.307427 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865f555-236c-48a4-b50a-a07acc19608d None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:23.308012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865f555-236c-48a4-b50a-a07acc19608d None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:23.308012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865f555-236c-48a4-b50a-a07acc19608d None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:23.314830 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa808-90eb-427b-85f8-83daf6991ce0 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:23.315310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa808-90eb-427b-85f8-83daf6991ce0 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:23.315398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa808-90eb-427b-85f8-83daf6991ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:23.318764 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 662/1307] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:23.471872 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-d60aa808-90eb-427b-85f8-83daf6991ce0 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:23.473258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-d60aa808-90eb-427b-85f8-83daf6991ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:23.726668 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 646/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:23.791784 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe69825-b071-4282-81d7-9e7aaf658fd8 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:23.792075 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe69825-b071-4282-81d7-9e7aaf658fd8 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:23.792353 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe69825-b071-4282-81d7-9e7aaf658fd8 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:23.794027 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 663/1309] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:23.809270 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e2034-45a0-4fb9-99ee-a68bb8b2032c None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:23.810525 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e2034-45a0-4fb9-99ee-a68bb8b2032c None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:23.811669 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e2034-45a0-4fb9-99ee-a68bb8b2032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:24.085679 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-605e2034-45a0-4fb9-99ee-a68bb8b2032c None None] MFA Rules not processed for user `db27b327147f455c979c2a3105476853`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:24.087252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-605e2034-45a0-4fb9-99ee-a68bb8b2032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:24.152671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:24.291393 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 647/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:24.302672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe69825-b071-4282-81d7-9e7aaf658fd8 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:24.304720 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-afe69825-b071-4282-81d7-9e7aaf658fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:24.472047 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe69825-b071-4282-81d7-9e7aaf658fd8 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:24.553675 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:24.554624 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:24.555105 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:24.555750 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:24.557612 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:24.618017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:24.684833 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:24.687084 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad1640-70d1-438c-94b2-6821f5d77b9d service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:24.720846 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 664/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:27.360952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76afad-61d3-4363-84dd-2c6cc0b633b6 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:27.361517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76afad-61d3-4363-84dd-2c6cc0b633b6 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:27.361517 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76afad-61d3-4363-84dd-2c6cc0b633b6 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:27.363207 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 648/1312] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:27.371421 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82e60-5621-42ab-8e86-6852f2aa071e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:27.371839 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82e60-5621-42ab-8e86-6852f2aa071e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:27.372184 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82e60-5621-42ab-8e86-6852f2aa071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:27.449186 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-b1f82e60-5621-42ab-8e86-6852f2aa071e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:27.450562 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-b1f82e60-5621-42ab-8e86-6852f2aa071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:27.583877 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 665/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:27.612779 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76afad-61d3-4363-84dd-2c6cc0b633b6 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:27.614414 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-9e76afad-61d3-4363-84dd-2c6cc0b633b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:27.745155 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76afad-61d3-4363-84dd-2c6cc0b633b6 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:27.833947 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:27.837046 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:27.837718 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:27.838023 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:27.838587 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:27.840428 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:27.967993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:27.969788 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd038-805b-4d91-b210-8de4aa20acc4 service neutron] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:27.991532 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 649/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:30.664481 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57d11-7fa4-48fd-b520-bb62c5d592e2 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:30.665004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57d11-7fa4-48fd-b520-bb62c5d592e2 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:30.665004 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57d11-7fa4-48fd-b520-bb62c5d592e2 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:30.667662 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 666/1315] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:30.672963 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea027-42ea-4619-a5f9-1801a8d3d4db None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:30.673426 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea027-42ea-4619-a5f9-1801a8d3d4db None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:30.673524 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea027-42ea-4619-a5f9-1801a8d3d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:30.737797 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-d33ea027-42ea-4619-a5f9-1801a8d3d4db None None] MFA Rules not processed for user `d07be9e7872649819e166ac1192258ae`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:30.739030 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-d33ea027-42ea-4619-a5f9-1801a8d3d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:30.789550 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:30.832593 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 650/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:30.873528 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57d11-7fa4-48fd-b520-bb62c5d592e2 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:30.875099 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-49a57d11-7fa4-48fd-b520-bb62c5d592e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:30.884718 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:30.984759 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57d11-7fa4-48fd-b520-bb62c5d592e2 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:31.068577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:31.069397 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:31.069684 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:31.069963 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:31.071645 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:31.133393 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:31.180200 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:31.181650 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6dd34-9054-45c2-98c7-724daa5da34c service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:31.199803 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 667/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:34.008311 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c50c-52d0-4104-9825-4d49f08ce546 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:34.008937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c50c-52d0-4104-9825-4d49f08ce546 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:34.008937 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c50c-52d0-4104-9825-4d49f08ce546 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:34.010815 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 651/1318] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:34.016327 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482aad-0338-4747-b608-499e0800d1a7 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:34.016757 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482aad-0338-4747-b608-499e0800d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:34.016882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482aad-0338-4747-b608-499e0800d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:34.081545 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-0a482aad-0338-4747-b608-499e0800d1a7 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:34.082768 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0a482aad-0338-4747-b608-499e0800d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:34.177782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 668/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:34.216895 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c50c-52d0-4104-9825-4d49f08ce546 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:34.218439 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-1110c50c-52d0-4104-9825-4d49f08ce546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:34.324039 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c50c-52d0-4104-9825-4d49f08ce546 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:34.404208 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:34.404855 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:34.405139 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:34.405417 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:34.407108 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:34.414469 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:34.514603 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:34.516073 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf54487-5881-4c24-bcfb-6be407161cc5 service neutron] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:34.533602 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 652/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:37.411860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c112f-f4ed-4225-8da9-8fb55d2a2f8b None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:37.412395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c112f-f4ed-4225-8da9-8fb55d2a2f8b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:37.412395 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c112f-f4ed-4225-8da9-8fb55d2a2f8b None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:37.413819 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 669/1321] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:37.419352 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166a7f9-725a-4e96-826e-8306b8ae3802 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:37.419751 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166a7f9-725a-4e96-826e-8306b8ae3802 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:37.419925 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166a7f9-725a-4e96-826e-8306b8ae3802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:37.484101 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-e166a7f9-725a-4e96-826e-8306b8ae3802 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:37.485301 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-e166a7f9-725a-4e96-826e-8306b8ae3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:37.543157 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:37.583295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 653/1322] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:37.618917 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c112f-f4ed-4225-8da9-8fb55d2a2f8b None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:37.620993 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-ac5c112f-f4ed-4225-8da9-8fb55d2a2f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:37.639704 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:37.724111 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c112f-f4ed-4225-8da9-8fb55d2a2f8b None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:37.799330 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:37.799964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:37.800246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:37.800519 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:37.802149 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:37.894669 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:37.935801 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:37.937277 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129af645-fc3a-4f60-a2fc-74731a0590b9 service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:37.955930 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 670/1323] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:40.261518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacddb5-dec7-4c0f-9907-41b270225326 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:40.262020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacddb5-dec7-4c0f-9907-41b270225326 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:40.262020 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacddb5-dec7-4c0f-9907-41b270225326 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:40.263398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 654/1324] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:40.268639 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff551e7-a5c1-4a96-afa3-612846d234b5 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:40.269074 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff551e7-a5c1-4a96-afa3-612846d234b5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:40.269221 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff551e7-a5c1-4a96-afa3-612846d234b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:40.336347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3ff551e7-a5c1-4a96-afa3-612846d234b5 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:40.337546 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3ff551e7-a5c1-4a96-afa3-612846d234b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:40.435140 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 671/1325] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:40.470803 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacddb5-dec7-4c0f-9907-41b270225326 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:40.472343 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-8bacddb5-dec7-4c0f-9907-41b270225326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:40.576576 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacddb5-dec7-4c0f-9907-41b270225326 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:40.651653 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:40.652304 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:40.652590 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:40.652869 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:40.654521 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:40.671921 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:40.764584 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:40.766037 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58186c69-22df-45f5-9ea1-2a4bc622bb19 service neutron] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:40.784429 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 655/1326] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:43.072739 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fca6a-e299-449e-a410-ed76ef840ae5 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:43.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fca6a-e299-449e-a410-ed76ef840ae5 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:43.073307 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fca6a-e299-449e-a410-ed76ef840ae5 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:43.074717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 672/1327] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:43.079952 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebfd4d-31d1-4438-a9c3-cc686dfd06b2 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:43.080330 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebfd4d-31d1-4438-a9c3-cc686dfd06b2 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:43.080518 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebfd4d-31d1-4438-a9c3-cc686dfd06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:43.144040 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-28ebfd4d-31d1-4438-a9c3-cc686dfd06b2 None None] MFA Rules not processed for user `d07be9e7872649819e166ac1192258ae`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:43.145241 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-28ebfd4d-31d1-4438-a9c3-cc686dfd06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:43.207708 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:43.239829 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 656/1328] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:43.276890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fca6a-e299-449e-a410-ed76ef840ae5 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:43.278442 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-0e6fca6a-e299-449e-a410-ed76ef840ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:43.309322 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:43.381832 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fca6a-e299-449e-a410-ed76ef840ae5 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:43.454384 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:43.455052 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:43.455334 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:43.455604 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:43.457246 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:43.533086 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:43.564520 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:43.565964 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee74d-ab87-4722-a518-6d2e73daba5d service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:43.584238 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 673/1329] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:46.024609 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432754c-9a01-4223-9cc3-b863b7226a37 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:46.025696 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432754c-9a01-4223-9cc3-b863b7226a37 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:46.025696 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432754c-9a01-4223-9cc3-b863b7226a37 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:46.027086 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 657/1330] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:46.032399 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674fd0-938d-4374-9db5-f351e4ec061b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:46.032795 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674fd0-938d-4374-9db5-f351e4ec061b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:46.032976 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674fd0-938d-4374-9db5-f351e4ec061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:46.095761 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-8b674fd0-938d-4374-9db5-f351e4ec061b None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:46.096975 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-8b674fd0-938d-4374-9db5-f351e4ec061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:46.192823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 674/1331] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:46.229762 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432754c-9a01-4223-9cc3-b863b7226a37 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:46.231331 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-f432754c-9a01-4223-9cc3-b863b7226a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:46.334652 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432754c-9a01-4223-9cc3-b863b7226a37 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:46.409050 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:46.409689 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:46.409973 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:46.410248 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:46.411910 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:46.438657 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:46.519314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:46.520758 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457ec2-df19-4e2c-8713-13ff6f26710c service neutron] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:46.538892 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 658/1332] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:48.810139 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7edc14-755f-44a9-bc7e-fe13a7ff5e42 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:48.810689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7edc14-755f-44a9-bc7e-fe13a7ff5e42 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:48.810813 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7edc14-755f-44a9-bc7e-fe13a7ff5e42 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:48.812185 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 675/1333] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:48.817538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48939bcd-3f17-497d-80cf-f2c782b0ad39 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:48.817951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48939bcd-3f17-497d-80cf-f2c782b0ad39 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:48.818098 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48939bcd-3f17-497d-80cf-f2c782b0ad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:48.881754 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-48939bcd-3f17-497d-80cf-f2c782b0ad39 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:48.882995 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-48939bcd-3f17-497d-80cf-f2c782b0ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:48.959516 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:48.983212 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 659/1334] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:49.023496 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7edc14-755f-44a9-bc7e-fe13a7ff5e42 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:49.025101 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-1a7edc14-755f-44a9-bc7e-fe13a7ff5e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:49.064989 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:49.128860 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7edc14-755f-44a9-bc7e-fe13a7ff5e42 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:49.200852 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:49.201491 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:49.201771 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:49.202044 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:49.203689 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:49.285944 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:49.312460 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:49.313909 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf0e7a-7b33-4621-bfb8-7c67156e923a service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:49.331782 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 676/1335] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:51.893189 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602695a-5308-42d0-9531-46627371beb4 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:51.893811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602695a-5308-42d0-9531-46627371beb4 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:51.893811 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602695a-5308-42d0-9531-46627371beb4 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:51.895178 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 660/1336] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:51.900455 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd054d-9705-440d-8cf4-c81a768b55aa None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:51.900923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd054d-9705-440d-8cf4-c81a768b55aa None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:51.901029 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd054d-9705-440d-8cf4-c81a768b55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:51.966052 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-bfcd054d-9705-440d-8cf4-c81a768b55aa None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:51.967306 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-bfcd054d-9705-440d-8cf4-c81a768b55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:52.064220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 677/1337] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:52.100348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602695a-5308-42d0-9531-46627371beb4 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:52.101913 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-0602695a-5308-42d0-9531-46627371beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:52.203946 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602695a-5308-42d0-9531-46627371beb4 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:52.277699 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:52.278346 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:52.278627 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:52.278934 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:52.280554 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:52.317228 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:52.389018 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:52.390447 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27638-174b-440b-9a53-7c7a231822c5 service neutron] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:52.408078 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 661/1338] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:42:56.669681 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea177b54-6989-4695-9f49-b03e05ceda8f None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:56.670268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea177b54-6989-4695-9f49-b03e05ceda8f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:56.670268 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea177b54-6989-4695-9f49-b03e05ceda8f None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:56.671672 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 678/1339] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:56.676913 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdfc2-c978-4801-bb8f-57d866c6f4b7 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:56.677361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdfc2-c978-4801-bb8f-57d866c6f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:56.677468 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdfc2-c978-4801-bb8f-57d866c6f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:56.753255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-0e6fdfc2-c978-4801-bb8f-57d866c6f4b7 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:56.754395 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-0e6fdfc2-c978-4801-bb8f-57d866c6f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:56.850299 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=100 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:42:56.864463 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 662/1340] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:56.916890 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3a7fd-d083-4ea7-917c-8139e2fe3e23 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:56.917304 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3a7fd-d083-4ea7-917c-8139e2fe3e23 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:56.917652 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3a7fd-d083-4ea7-917c-8139e2fe3e23 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:56.919220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 679/1341] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:42:56.925151 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e272-0bca-417a-8f1a-0e18e64811a1 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:56.925446 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e272-0bca-417a-8f1a-0e18e64811a1 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:56.925722 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e272-0bca-417a-8f1a-0e18e64811a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:56.997619 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-49f8e272-0bca-417a-8f1a-0e18e64811a1 None None] MFA Rules not processed for user `db27b327147f455c979c2a3105476853`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:42:56.998828 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-49f8e272-0bca-417a-8f1a-0e18e64811a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:42:57.076514 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 663/1342] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:42:57.085594 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3a7fd-d083-4ea7-917c-8139e2fe3e23 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:42:57.098533 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3a7fd-d083-4ea7-917c-8139e2fe3e23 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:42:57.102635 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f428a3a-b86a-43aa-a05a-db0acc99eb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:42:57.103412 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428a3a-b86a-43aa-a05a-db0acc99eb32 service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:42:57.103691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428a3a-b86a-43aa-a05a-db0acc99eb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:42:57.104220 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428a3a-b86a-43aa-a05a-db0acc99eb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:42:57.114543 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f428a3a-b86a-43aa-a05a-db0acc99eb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:42:57.116045 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f428a3a-b86a-43aa-a05a-db0acc99eb32 service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:42:57.126682 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 680/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:00.541461 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840169-0041-4cd7-a522-57751688af33 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:00.541993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840169-0041-4cd7-a522-57751688af33 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:00.541993 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840169-0041-4cd7-a522-57751688af33 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:00.543359 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 664/1344] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:00.548577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa49f-782a-430e-bfe3-cc5827d7b80e None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:00.549036 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa49f-782a-430e-bfe3-cc5827d7b80e None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:00.549147 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa49f-782a-430e-bfe3-cc5827d7b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:00.576530 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-b8afa49f-782a-430e-bfe3-cc5827d7b80e None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:00.577721 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-b8afa49f-782a-430e-bfe3-cc5827d7b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:00.595747 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:43:00.655717 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 681/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:00.691997 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840169-0041-4cd7-a522-57751688af33 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:43:00.703072 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840169-0041-4cd7-a522-57751688af33 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:43:00.706583 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8f8dd-3d1f-42e8-966c-e7ef1b859c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:43:00.707258 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f8dd-3d1f-42e8-966c-e7ef1b859c9c service neutron] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:00.707544 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f8dd-3d1f-42e8-966c-e7ef1b859c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:00.707823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f8dd-3d1f-42e8-966c-e7ef1b859c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:00.717476 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8f8dd-3d1f-42e8-966c-e7ef1b859c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:43:00.718955 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8f8dd-3d1f-42e8-966c-e7ef1b859c9c service neutron] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:43:00.728401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 665/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:43:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:05.231631 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff63d-648b-410c-a814-5ca2fdb09790 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:05.232201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff63d-648b-410c-a814-5ca2fdb09790 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:05.232201 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff63d-648b-410c-a814-5ca2fdb09790 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:05.233588 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 682/1347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:05.238835 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a9443-131f-4de8-af22-91eac0f9c15a None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:05.239255 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a9443-131f-4de8-af22-91eac0f9c15a None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:05.239398 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a9443-131f-4de8-af22-91eac0f9c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:05.257284 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-5c1a9443-131f-4de8-af22-91eac0f9c15a None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:05.258508 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-5c1a9443-131f-4de8-af22-91eac0f9c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:05.269963 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 666/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:05.311569 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff63d-648b-410c-a814-5ca2fdb09790 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:43:05.323132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff63d-648b-410c-a814-5ca2fdb09790 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:43:05.326850 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07806d2-2d6e-467b-add3-0e371f7a2e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db27b327147f455c979c2a3105476853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:43:05.327561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07806d2-2d6e-467b-add3-0e371f7a2e90 service neutron] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:05.327848 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07806d2-2d6e-467b-add3-0e371f7a2e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:05.328132 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07806d2-2d6e-467b-add3-0e371f7a2e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:05.337865 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07806d2-2d6e-467b-add3-0e371f7a2e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:43:05.339357 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07806d2-2d6e-467b-add3-0e371f7a2e90 service neutron] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:43:05.349111 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 683/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:10.746458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55770e6-4c59-42c4-8a35-80b101137afc None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:10.746458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55770e6-4c59-42c4-8a35-80b101137afc None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:10.746458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55770e6-4c59-42c4-8a35-80b101137afc None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:10.746458 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 667/1350] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:43:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:10.747318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6e923-b02b-40a3-8ab3-4fe916bea56f None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:10.747318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6e923-b02b-40a3-8ab3-4fe916bea56f None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:10.747318 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6e923-b02b-40a3-8ab3-4fe916bea56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:10.795815 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3de6e923-b02b-40a3-8ab3-4fe916bea56f None None] MFA Rules not processed for user `292407edfaf14822b25f069c5e3c98be`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:10.797017 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3de6e923-b02b-40a3-8ab3-4fe916bea56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:10.901602 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 684/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:43:15.223183 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f815f-d98c-45e5-83a7-76d548d712cd None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:15.223706 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f815f-d98c-45e5-83a7-76d548d712cd None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:15.223827 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f815f-d98c-45e5-83a7-76d548d712cd None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:15.225092 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 668/1352] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:15.231441 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b96cb-70b4-4510-9290-21af2b6fded7 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:15.231856 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b96cb-70b4-4510-9290-21af2b6fded7 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:15.232026 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b96cb-70b4-4510-9290-21af2b6fded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:15.251209 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-f46b96cb-70b4-4510-9290-21af2b6fded7 None None] MFA Rules not processed for user `292407edfaf14822b25f069c5e3c98be`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:15.252327 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=66 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:43:15.252823 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-f46b96cb-70b4-4510-9290-21af2b6fded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:15.267567 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 685/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:17.083425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dcec4-2fe4-46b9-aa22-b27f51c85803 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:17.083972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dcec4-2fe4-46b9-aa22-b27f51c85803 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:17.083972 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dcec4-2fe4-46b9-aa22-b27f51c85803 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:17.085361 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 669/1354] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:17.090673 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33fc5f-1a6f-4afd-8a85-682aff5cd5bd None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:17.091137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33fc5f-1a6f-4afd-8a85-682aff5cd5bd None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:17.091286 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33fc5f-1a6f-4afd-8a85-682aff5cd5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:17.110180 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-2e33fc5f-1a6f-4afd-8a85-682aff5cd5bd None None] MFA Rules not processed for user `292407edfaf14822b25f069c5e3c98be`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:17.111347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-2e33fc5f-1a6f-4afd-8a85-682aff5cd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:17.120179 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 686/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:43:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:21.007355 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cfce3-6abe-490b-b4be-46810d45bf71 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:21.007951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cfce3-6abe-490b-b4be-46810d45bf71 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:21.007951 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cfce3-6abe-490b-b4be-46810d45bf71 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:21.009401 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 670/1356] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:21.014437 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e9aa-684c-43e4-bcde-9ebaa051b888 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:21.014900 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e9aa-684c-43e4-bcde-9ebaa051b888 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:21.015037 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e9aa-684c-43e4-bcde-9ebaa051b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:21.033818 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-1ec4e9aa-684c-43e4-bcde-9ebaa051b888 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:21.035059 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-1ec4e9aa-684c-43e4-bcde-9ebaa051b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:21.044137 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 687/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:21.099548 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8afc-093d-4bf4-9804-61d0a97e0c24 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:21.100232 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8afc-093d-4bf4-9804-61d0a97e0c24 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:21.100981 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8afc-093d-4bf4-9804-61d0a97e0c24 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:21.103996 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 671/1358] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:43:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:21.113126 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45203f-9722-4ad3-9d31-36029c94d57c None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:21.114642 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45203f-9722-4ad3-9d31-36029c94d57c None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:21.115347 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45203f-9722-4ad3-9d31-36029c94d57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:21.189258 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-3b45203f-9722-4ad3-9d31-36029c94d57c None None] MFA Rules not processed for user `d0d0efbde33d4360ad47bd0c7a545edd`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:21.190661 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-3b45203f-9722-4ad3-9d31-36029c94d57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:21.196695 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=100 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:43:21.288998 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 688/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:43:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:21.297737 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb8afc-093d-4bf4-9804-61d0a97e0c24 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:43:21.312697 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb8afc-093d-4bf4-9804-61d0a97e0c24 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:43:21.318124 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac27e7-9aa5-4187-aee1-c6e54816f33a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d0efbde33d4360ad47bd0c7a545edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:43:21.318742 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac27e7-9aa5-4187-aee1-c6e54816f33a service nova] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:21.319175 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac27e7-9aa5-4187-aee1-c6e54816f33a service nova] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:21.319456 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac27e7-9aa5-4187-aee1-c6e54816f33a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:21.328380 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac27e7-9aa5-4187-aee1-c6e54816f33a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:43:21.330295 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac27e7-9aa5-4187-aee1-c6e54816f33a service nova] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:43:21.342087 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 672/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:23.769561 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb591f-efa3-4c6c-85d3-3e6ff156f876 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:23.770120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb591f-efa3-4c6c-85d3-3e6ff156f876 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:23.770120 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb591f-efa3-4c6c-85d3-3e6ff156f876 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:23.771551 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 689/1361] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:23.777106 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518245-612d-4d47-887d-bfc44e7b55ab None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:23.777556 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518245-612d-4d47-887d-bfc44e7b55ab None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:23.777671 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518245-612d-4d47-887d-bfc44e7b55ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:23.796341 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-19518245-612d-4d47-887d-bfc44e7b55ab None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:23.797741 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-19518245-612d-4d47-887d-bfc44e7b55ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:23.808511 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 673/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:23.853251 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb591f-efa3-4c6c-85d3-3e6ff156f876 None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:43:23.869648 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb591f-efa3-4c6c-85d3-3e6ff156f876 None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:43:23.875359 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8dc47-8132-40ad-8926-7c1c57b7c83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d0efbde33d4360ad47bd0c7a545edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:43:23.876012 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dc47-8132-40ad-8926-7c1c57b7c83d service nova] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:23.876298 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dc47-8132-40ad-8926-7c1c57b7c83d service nova] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:23.876577 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dc47-8132-40ad-8926-7c1c57b7c83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:23.886314 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8dc47-8132-40ad-8926-7c1c57b7c83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:43:23.887972 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8dc47-8132-40ad-8926-7c1c57b7c83d service nova] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:43:23.897904 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 690/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:26.465043 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb187de9-3fee-4c0b-89f4-829b676b1dbc None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:26.465637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb187de9-3fee-4c0b-89f4-829b676b1dbc None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:26.465637 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb187de9-3fee-4c0b-89f4-829b676b1dbc None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:26.467021 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 674/1364] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:26.472900 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367fc1-5429-488e-9d66-c38e5cc70dd9 None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:26.473434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367fc1-5429-488e-9d66-c38e5cc70dd9 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:26.473434 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367fc1-5429-488e-9d66-c38e5cc70dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:26.492537 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-5e367fc1-5429-488e-9d66-c38e5cc70dd9 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:26.493882 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-5e367fc1-5429-488e-9d66-c38e5cc70dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:26.502169 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 691/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:26.549160 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c77fe5-c2d7-4384-a104-5acc57efbd85 None None] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:26.549538 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c77fe5-c2d7-4384-a104-5acc57efbd85 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:26.549915 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c77fe5-c2d7-4384-a104-5acc57efbd85 None None] PATH_INFO: `/` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:26.551670 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 675/1366] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:26.557877 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84812e9-5f5b-48a1-95c5-6cb85127b43b None None] REQUEST_METHOD: `POST` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:26.558243 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84812e9-5f5b-48a1-95c5-6cb85127b43b None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:26.558605 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84812e9-5f5b-48a1-95c5-6cb85127b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:26.577080 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.auth.core [None req-e84812e9-5f5b-48a1-95c5-6cb85127b43b None None] MFA Rules not processed for user `d0d0efbde33d4360ad47bd0c7a545edd`. Rule list: `[]` (Enabled: `True`). {{(pid=206999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:26.578401 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.fernet_utils [None req-e84812e9-5f5b-48a1-95c5-6cb85127b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:26.588693 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 692/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:26.596495 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c77fe5-c2d7-4384-a104-5acc57efbd85 None None] Authenticating user token {{(pid=206998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:43:26.611950 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c77fe5-c2d7-4384-a104-5acc57efbd85 None None] Validating token access rules against request {{(pid=206998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:43:26.617598 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b223ac5-be5f-440e-bffe-c220ddc7d1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d0efbde33d4360ad47bd0c7a545edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:43:26.618314 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223ac5-be5f-440e-bffe-c220ddc7d1b4 service nova] REQUEST_METHOD: `GET` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:26.618673 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223ac5-be5f-440e-bffe-c220ddc7d1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:26.619083 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223ac5-be5f-440e-bffe-c220ddc7d1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:26.628579 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b223ac5-be5f-440e-bffe-c220ddc7d1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:43:26.630310 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b223ac5-be5f-440e-bffe-c220ddc7d1b4 service nova] RBAC: Authorization granted {{(pid=206998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:43:26.641348 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 676/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:27.540853 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f73bf-381b-48fc-8746-938ea376bb85 None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:27.541388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f73bf-381b-48fc-8746-938ea376bb85 None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:27.541388 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f73bf-381b-48fc-8746-938ea376bb85 None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:27.542691 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 693/1369] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:27.548252 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9521c-f2fb-4df3-9894-67f401766daf None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:27.548682 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9521c-f2fb-4df3-9894-67f401766daf None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:27.548808 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9521c-f2fb-4df3-9894-67f401766daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:27.571555 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-0ed9521c-f2fb-4df3-9894-67f401766daf None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:27.572823 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-0ed9521c-f2fb-4df3-9894-67f401766daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:27.581667 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 677/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:28.991959 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90919585-f89d-429b-b31e-b25d507768da None None] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:28.992532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90919585-f89d-429b-b31e-b25d507768da None None] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:28.992532 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90919585-f89d-429b-b31e-b25d507768da None None] PATH_INFO: `/` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:28.993913 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 694/1371] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:43:28.999425 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db6b6-0500-47f9-bb80-8c156a7cd477 None None] REQUEST_METHOD: `POST` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:28.999868 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db6b6-0500-47f9-bb80-8c156a7cd477 None None] SCRIPT_NAME: `/identity` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:28.999977 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db6b6-0500-47f9-bb80-8c156a7cd477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:29.019789 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.auth.core [None req-d12db6b6-0500-47f9-bb80-8c156a7cd477 None None] MFA Rules not processed for user `36e70edefbb144ebbbd97da5f321c823`. Rule list: `[]` (Enabled: `True`). {{(pid=206998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:43:29.025422 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG keystone.common.fernet_utils [None req-d12db6b6-0500-47f9-bb80-8c156a7cd477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:43:29.033334 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: [pid: 206998|app: 0|req: 678/1372] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:43:29.076394 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90919585-f89d-429b-b31e-b25d507768da None None] Authenticating user token {{(pid=206999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:43:29.091438 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90919585-f89d-429b-b31e-b25d507768da None None] Validating token access rules against request {{(pid=206999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:43:29.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6e3cc-bb34-420a-bf89-9178c7405109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d0efbde33d4360ad47bd0c7a545edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '529a5360fb034eec991b1cb4e5c449a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:43:29.097541 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6e3cc-bb34-420a-bf89-9178c7405109 service nova] REQUEST_METHOD: `GET` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:43:29.097825 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6e3cc-bb34-420a-bf89-9178c7405109 service nova] SCRIPT_NAME: `/identity` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:43:29.098103 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6e3cc-bb34-420a-bf89-9178c7405109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:43:29.106544 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6e3cc-bb34-420a-bf89-9178c7405109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:43:29.108172 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6e3cc-bb34-420a-bf89-9178c7405109 service nova] RBAC: Authorization granted {{(pid=206999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:43:29.117548 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: [pid: 206999|app: 0|req: 695/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:43:39.013790 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: DEBUG dbcounter [-] [206998] Writing DB stats keystone:SELECT=21 {{(pid=206998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:43:39.113391 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: DEBUG dbcounter [-] [206999] Writing DB stats keystone:SELECT=51 {{(pid=206999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:43:51.212066 dv-cinder-788367-10-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 19 14:43:51.212393 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: Thu May 19 14:43:51 2022 - graceful shutdown triggered... May 19 14:43:51.213014 dv-cinder-788367-10-iscsi devstack@keystone.service[206998]: Gracefully killing worker 1 (pid: 206998)... May 19 14:43:51.213414 dv-cinder-788367-10-iscsi devstack@keystone.service[206999]: Gracefully killing worker 2 (pid: 206999)... May 19 14:43:52.214134 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: worker 1 buried after 1 seconds May 19 14:43:52.214134 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: worker 2 buried after 1 seconds May 19 14:43:52.214134 dv-cinder-788367-10-iscsi devstack@keystone.service[206990]: goodbye to uWSGI. May 19 14:43:52.215839 dv-cinder-788367-10-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 19 14:43:52.216389 dv-cinder-788367-10-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 19 14:49:45.785629 dv-cinder-788367-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 14:49:45.796456 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 14:49:45 2022] *** May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: nodename: dv-cinder-788367-10-iscsi May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: machine: x86_64 May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: clock source: unix May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: pcre jit disabled May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: detected number of CPU cores: 4 May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: current working directory: / May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: detected binary path: /usr/bin/uwsgi-core May 19 14:49:45.798461 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: your processes number limit is 47680 May 19 14:49:45.799399 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: your memory page size is 4096 bytes May 19 14:49:45.799399 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: detected max file descriptor number: 2048 May 19 14:49:45.799399 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: lock engine: pthread robust mutexes May 19 14:49:45.799399 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: thunder lock: enabled May 19 14:49:45.799399 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 14:49:45.799399 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 14:49:45.844604 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: Python main interpreter initialized at 0x5642a6ab29c0 May 19 14:49:45.844604 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: python threads support enabled May 19 14:49:45.844604 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: your server socket listen backlog is limited to 100 connections May 19 14:49:45.844604 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: your mercy for graceful operations on workers is 90 seconds May 19 14:49:45.844988 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: mapped 403077 bytes (393 KB) for 2 cores May 19 14:49:45.844988 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: *** Operational MODE: preforking *** May 19 14:49:45.845259 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: *** uWSGI is running in multiple interpreter mode *** May 19 14:49:45.845259 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: spawned uWSGI master process (pid: 270169) May 19 14:49:45.845445 dv-cinder-788367-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 14:49:45.846529 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: spawned uWSGI worker 1 (pid: 270180, cores: 1) May 19 14:49:45.846529 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: spawned uWSGI worker 2 (pid: 270181, cores: 1) May 19 14:49:45.846529 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 14:49:51.623715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:49:51.623715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: from cryptography.utils import int_from_bytes May 19 14:49:51.624632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:49:51.624632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: from cryptography.utils import int_from_bytes May 19 14:49:51.625143 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:49:51.625143 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: from cryptography.utils import int_from_bytes May 19 14:49:51.625305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:49:51.625305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: from cryptography.utils import int_from_bytes May 19 14:49:51.673409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:49:51.673592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:49:51.673782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] command line args: [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:49:51.673967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:49:51.674071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:49:51.674164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:49:51.674265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ================================================================================ {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:49:51.674358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] command line args: [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:49:51.674480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] admin_token = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.674599 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:49:51.674728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] config_dir = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.674857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ================================================================================ {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:49:51.674956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675049 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] admin_token = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675143 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] config_source = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] config_dir = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] debug = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675580 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] config_source = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.675853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] debug = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676727 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] insecure_debug = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.676974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_config_append = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_dir = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677792 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_config_append = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_file = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.677977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_dir = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_file = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678680 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.678954 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679102 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679359 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.679894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680243 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.680918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681214 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] notification_format = cadf {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681770 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] publish_errors = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681770 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.681943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] publish_errors = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682324 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682422 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682697 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] standard_threads = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.682919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] standard_threads = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683396 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] use_journal = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] strict_password_check = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] use_json = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.683775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] use_stderr = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] use_eventlog = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] use_syslog = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] use_journal = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] use_json = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.684973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.685065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] use_stderr = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.685157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.685249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] use_syslog = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.685414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] watch_log_file = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:49:51.685517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.685654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.685753 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.685906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686503 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686632 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.686908 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687012 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687890 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.687991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688615 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.688967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689711 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.689949 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.690971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691208 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691436 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691804 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.691920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692383 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692521 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.692846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693002 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.693948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694055 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694651 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694746 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.694913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695479 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.695939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696419 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696789 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.696890 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697491 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697599 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697730 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.697967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698442 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698541 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698840 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.698945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.699034 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.699176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.699280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.699442 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.700868 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701830 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.701939 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702032 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702185 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702686 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.702953 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.703922 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704405 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704505 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.enabled = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.704985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705355 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705501 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.705923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706067 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.706920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707293 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707527 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.707989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708091 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708452 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708795 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.708913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709012 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709239 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709619 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709856 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.709980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710243 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.external = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.710977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.external = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.mapped = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711811 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.password = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.711924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] auth.token = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712268 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712505 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.password = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] auth.token = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712890 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.712984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] catalog.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713727 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.713966 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714451 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714696 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.714947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715610 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.715964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716099 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716199 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716355 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716741 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.716995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.717151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.717253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.717651 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.717766 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.717914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718015 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718893 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.718990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719474 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719851 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.719945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720187 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720578 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.720921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721185 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.721995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722101 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722241 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722860 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.722973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723213 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.723914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724631 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724780 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.724877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725145 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725698 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.725942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726652 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.726879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727502 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727604 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.727975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728327 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728801 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.728944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729274 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.729986 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.730119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.730225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.730355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.password = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.730454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.730590 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731625 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.731974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732589 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.732939 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733413 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.733899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734120 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734270 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.734919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735251 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735819 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.735954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736649 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.736993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737135 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737475 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.737992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738082 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738860 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.738958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739345 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739607 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739738 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739839 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.739975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740339 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.740914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] policy.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741243 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.741958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] receipt.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.742952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.743925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744436 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744901 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] revoke.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.744995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] role.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] role.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745466 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745570 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] role.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] role.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.745958 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.746066 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] role.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.746193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] role.list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.746296 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747371 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.747874 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748507 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.748860 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749350 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.749976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.750133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.750372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.750468 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.750614 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.750728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.750892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751389 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751749 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.751982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752347 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752581 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752685 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.752930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.753898 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754027 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754263 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754365 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.754848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755107 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.provider = fernet {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755830 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.755983 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756322 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756819 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.756953 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757302 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] trust.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.757913 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758410 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758845 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.connection = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.758940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759443 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759541 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.connection = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.759921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760637 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.760984 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761115 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761214 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761587 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761764 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.761866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762143 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762804 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.762910 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.763054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.763161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.763260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:49:51.763370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.763608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.763855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.764095 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:49:51.764269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:49:51.794256 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.794482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.794707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.794839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.795084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.795319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.803489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.804225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.832609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.832844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.833699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.833938 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.884806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.885753 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.936016 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.936280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.937573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:51.937815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.001191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.001425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.001651 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.001876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.001982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.002101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.002196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.002319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.002564 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.002808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.005332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.025755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.025997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.026957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.027089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.027188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.027287 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.027377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.027587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.038886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.039432 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.053550 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.053785 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.054900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.055000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.055136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.055357 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:49:52.072482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.072695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:49:52.073036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.073218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.073322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:49:52.073417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:49:52.073505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.073749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.073857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.073947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:49:52.074033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.074209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.074312 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.074538 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.074831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.075100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.085440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.085720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.085994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.086279 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.086381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.086652 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.086951 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.087240 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.095251 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.096289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.098526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.098828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.099118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.099512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.099613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.099799 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.099905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100521 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.100914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.101078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.101190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.101353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.101454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.101631 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.101908 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.102188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.102459 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.128571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.129710 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.130214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.130497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.131363 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.131650 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.135881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.136121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.136399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.137620 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.137946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.143802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.144086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.145346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.145634 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.148705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.148994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.149277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.149557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.149834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.150112 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.150290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.150393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.150588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.150725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.150895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.151182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.151460 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.151737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.152011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.152284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.170282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.170557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.172314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.172597 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.175900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.177590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.181476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.181778 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.181883 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.182076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.187078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.187189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.190622 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.190732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.194348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.194494 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.194650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.194815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.194963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.195108 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.195247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.195399 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.195509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.195684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.195836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.196005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.214740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.215684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.215816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.215959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.216359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.216478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.216760 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.217168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.224607 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.225779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.226330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.226612 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.227560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.227831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.229708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.229990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.230277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.230557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.231446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.231548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.231736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.232034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.232318 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.232596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.244787 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.245068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.245353 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.245638 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.245921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.246024 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.246216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.246335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.246529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.246627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.246924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.247209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.247488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.247767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.264800 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.265926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.268084 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.269237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.271423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.272600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.273016 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.274206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.274658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.274970 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.275258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.275920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.276213 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.276500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.283267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.284641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.284884 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.286286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.288148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.288439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.288723 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.289000 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.289536 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.289832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.290132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.290417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.298893 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.299191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.299475 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.300271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.300569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.300855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.307453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=270181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.307749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.308033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.308313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.308596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.309394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=270180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:49:52.309516 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.309680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.309781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.309951 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.310918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311102 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311488 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=270181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.311944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.312229 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.312495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.312771 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.313036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=270180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:49:52.351184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5642a6ab29c0 pid: 270181 (default app) May 19 14:49:52.352663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5642a6ab29c0 pid: 270180 (default app) May 19 14:49:52.354530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151761b-45a7-45e8-b1f6-f2a22629721a None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:49:52.354847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151761b-45a7-45e8-b1f6-f2a22629721a None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:49:52.355132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151761b-45a7-45e8-b1f6-f2a22629721a None None] PATH_INFO: `/v3` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:49:52.359500 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu May 19 14:49:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:00.419600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:00.420181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:00.420181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:00.424455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:00.429580 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:00.429985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:00.430156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:00.499242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: INFO dbcounter [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] Registered counter for database keystone May 19 14:50:00.521113 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG oslo_db.sqlalchemy.engines [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=270181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:50:00.527626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writer thread running {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:50:00.712113 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG passlib.handlers.bcrypt [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=270181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:50:00.712547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG passlib.handlers.bcrypt [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=270181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:50:00.768560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:00.770187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:00.896363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 14:50:00.920018 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:00.989441 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: INFO dbcounter [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] Registered counter for database keystone May 19 14:50:01.009218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG oslo_db.sqlalchemy.engines [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=270180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:50:01.015690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writer thread running {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:50:01.144473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95f597-2b29-4658-9955-602ceb937932 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:01.148793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b35e1e6e2b6d410f8c2e43cf79c90c85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:01.149461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:01.149751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:01.150036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:01.159298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:01.210073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:50:01.210423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b282-60c9-4369-8cec-91f6fb864a04 admin admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:01.220906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:50:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:50:01.227063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:01.242310 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc148-92a1-4cd4-b36c-976b513c1927 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:01.247375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b35e1e6e2b6d410f8c2e43cf79c90c85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:01.248506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:01.248801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:01.249086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] PATH_INFO: `/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:01.250634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] RBAC: Authorizing `identity:get_project(project_id=b35e1e6e2b6d410f8c2e43cf79c90c85)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:01.411773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:50:01.412124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ceeb-4d2a-4620-b3a4-67ce748b7508 admin admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:01.416906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu May 19 14:50:01 2022] GET /identity/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:03.602962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cb4d-e9d0-4f04-8ded-e2da352c9064 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:03.603538 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cb4d-e9d0-4f04-8ded-e2da352c9064 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:03.603538 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cb4d-e9d0-4f04-8ded-e2da352c9064 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:03.608334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:03.613818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:03.614239 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:03.614402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:03.633291 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:03.634862 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:03.643416 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 14:50:03.669515 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343cb4d-e9d0-4f04-8ded-e2da352c9064 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:03.681723 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343cb4d-e9d0-4f04-8ded-e2da352c9064 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:03.686499 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ef139-86d4-4b01-8cda-e2c8bbedb2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b35e1e6e2b6d410f8c2e43cf79c90c85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:03.687174 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ef139-86d4-4b01-8cda-e2c8bbedb2aa admin admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:03.687464 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ef139-86d4-4b01-8cda-e2c8bbedb2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:03.687744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ef139-86d4-4b01-8cda-e2c8bbedb2aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:03.695463 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ef139-86d4-4b01-8cda-e2c8bbedb2aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:03.697397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ef139-86d4-4b01-8cda-e2c8bbedb2aa admin admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:03.706667 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu May 19 14:50:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:50:03.711989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:03.721423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca908f7-2077-4382-a7aa-ca53daa5364e None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:03.725904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34fb3-2514-486f-beb0-8b603d2844d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b35e1e6e2b6d410f8c2e43cf79c90c85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:03.726783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34fb3-2514-486f-beb0-8b603d2844d2 admin admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:03.727106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34fb3-2514-486f-beb0-8b603d2844d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:03.727395 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34fb3-2514-486f-beb0-8b603d2844d2 admin admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:03.728808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e34fb3-2514-486f-beb0-8b603d2844d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:03.731227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e34fb3-2514-486f-beb0-8b603d2844d2 admin admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:03.732810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu May 19 14:50:03 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:06.021800 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912d289-8e6a-41b1-84a6-3b0b233e8a16 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.022250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912d289-8e6a-41b1-84a6-3b0b233e8a16 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.022356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912d289-8e6a-41b1-84a6-3b0b233e8a16 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.023787 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:06.029008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.029454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.029718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.043321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b87d7-352b-4c6d-b70e-60a808d82cba None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.043746 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b87d7-352b-4c6d-b70e-60a808d82cba None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.043960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b87d7-352b-4c6d-b70e-60a808d82cba None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.045293 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:06.047982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:06.049190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:06.050614 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.050962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.051260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.092429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG passlib.handlers.bcrypt [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=270180) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:50:06.092882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG passlib.handlers.bcrypt [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=270180) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:50:06.130215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:06.139457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:06.141074 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:06.153872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.178179 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.248050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:06.270022 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.281633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e696-4fe2-441a-81fc-bddb4afd265e None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.317691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.318531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.318855 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.319146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.332357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:06.344907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:06.346379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:06.347611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:06.352488 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.440345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.458959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f620b-e115-4875-96cc-8538b3c42260 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.483713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2989d-ee1e-435d-93e6-3ac314d44671 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.486164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.494364 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.495083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.495380 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.496174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.496958 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:06.497270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:06.498707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:06.510973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:06.516979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.523571 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.524439 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.524739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.525027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.596891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:06.598414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:06.623336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a95f48-c437-4b58-bac2-0d64d0d9b673 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.657301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.658188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.658473 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.658761 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.660135 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:06.661605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:06.663278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 9/16] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:06.668583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.682705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.699477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:50:06.704985 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.707698 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.770157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f379ef-a196-45c2-8fbc-95a69d02388b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.805174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.805911 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.806206 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.806490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.806736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4076ee-4978-4856-98b9-5c30ee3a5ec3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.807752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:06.809886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:06.811623 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:06.817277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.847176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.847974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.848262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.848544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.867448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:06.868942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:50:06.889937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:06.891086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:06.892059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:50:06.892059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:50:06.892059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:06.892059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:06.892059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:06.897163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:06.898834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.918593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496d83-d6db-4b2a-a51f-cbd76f99c592 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:06.952741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:06.953524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:06.953820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:06.954106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:06.955003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.domain.id=default, user.id=5c3cc6fae8b64bde852a1c9bdb227ae0) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:06.955329 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:06.956167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:06.956881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404175e0-5f1d-480c-99ce-229aea1a04b0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:06.963915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/role_assignments?user.id=5c3cc6fae8b64bde852a1c9bdb227ae0&scope.domain.id=default&role.id=40636a8261d645b6a2041281c7044370 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:07.006231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232d8f8-1942-47b1-a8a2-ca8ff71da7f9 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:07.047281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:07.048008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:07.048250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:07.048535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:07.049294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:07.049612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:07.051074 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33bfea-a700-46ae-ae91-4340643f852f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:07.071200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:09.359310 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443fac8-1e6a-4450-87aa-eb94e78c9358 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:09.359826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443fac8-1e6a-4450-87aa-eb94e78c9358 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:09.359826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443fac8-1e6a-4450-87aa-eb94e78c9358 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:09.361175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:09.366564 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:09.367382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:09.367829 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:09.391795 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:09.393281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:09.476142 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:09.503335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443fac8-1e6a-4450-87aa-eb94e78c9358 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:09.647809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443fac8-1e6a-4450-87aa-eb94e78c9358 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:09.703538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb886c-dfe5-4d4f-9d38-c1a83e91d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:09.704657 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb886c-dfe5-4d4f-9d38-c1a83e91d98f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:09.705118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb886c-dfe5-4d4f-9d38-c1a83e91d98f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:09.705567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb886c-dfe5-4d4f-9d38-c1a83e91d98f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:09.719693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb886c-dfe5-4d4f-9d38-c1a83e91d98f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-4bdb886c-dfe5-4d4f-9d38-c1a83e91d98f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:09.727777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:09.728985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:09.730891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:09.733444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 13/24] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:09.742004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:09.805935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:09.885852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306430cf-a2ee-488b-9439-29ef17d6f72a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:09.895939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc859e-3950-42fe-862b-fa89b868d33b None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:09.896288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc859e-3950-42fe-862b-fa89b868d33b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:09.896407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc859e-3950-42fe-862b-fa89b868d33b None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:09.897808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 14/25] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:09.907322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:09.907545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:09.907794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:09.927164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:09.939890 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:09.941155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:09.957483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:09.958185 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:09.958479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:09.958766 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:09.959576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:09.959894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:09.961310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:09.978048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 12/26] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:09.984465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:10.101385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 15/27] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:10.143872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:10.182003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84e3f7-f568-4ee7-ac27-48cc05815a94 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:10.207196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:10.255539 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9aa4f-e6c7-4bed-b787-8ba66abfa846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:10.256451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9aa4f-e6c7-4bed-b787-8ba66abfa846 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.256746 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9aa4f-e6c7-4bed-b787-8ba66abfa846 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.257034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9aa4f-e6c7-4bed-b787-8ba66abfa846 None admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.258666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9aa4f-e6c7-4bed-b787-8ba66abfa846 None admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:10.260196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9aa4f-e6c7-4bed-b787-8ba66abfa846 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:10.262554 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 13/28] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:09 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:10.268220 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a936-c6d6-49f7-8f74-a9bec20a9dee None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.268519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a936-c6d6-49f7-8f74-a9bec20a9dee None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.268853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a936-c6d6-49f7-8f74-a9bec20a9dee None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.270166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 14/29] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:10.270993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86a936-c6d6-49f7-8f74-a9bec20a9dee None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:10.319182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7b9d4-07e2-4192-8a27-957b75a1e5a5 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:10.385977 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173a316-1f3d-4c8a-9c86-6c5ad090fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:10.388304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a316-1f3d-4c8a-9c86-6c5ad090fd34 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.388770 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a316-1f3d-4c8a-9c86-6c5ad090fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.389215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a316-1f3d-4c8a-9c86-6c5ad090fd34 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.390152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a316-1f3d-4c8a-9c86-6c5ad090fd34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:10.391754 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a316-1f3d-4c8a-9c86-6c5ad090fd34 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:10.395573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:10.429205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86a936-c6d6-49f7-8f74-a9bec20a9dee None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:10.468337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1fe4-5ebe-40e8-a8a0-e279f08acbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:10.469627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1fe4-5ebe-40e8-a8a0-e279f08acbc2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.470170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1fe4-5ebe-40e8-a8a0-e279f08acbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.470662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1fe4-5ebe-40e8-a8a0-e279f08acbc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.472299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1fe4-5ebe-40e8-a8a0-e279f08acbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:10.474109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1fe4-5ebe-40e8-a8a0-e279f08acbc2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:10.476080 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 15/30] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:10.477624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb56b-37e2-483d-b632-a5f5a2176089 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.478202 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb56b-37e2-483d-b632-a5f5a2176089 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.478717 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb56b-37e2-483d-b632-a5f5a2176089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.499086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-ae5fb56b-37e2-483d-b632-a5f5a2176089 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:10.500754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-ae5fb56b-37e2-483d-b632-a5f5a2176089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:10.549330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:10.551913 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 16/31] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:50:10 2022] POST /identity/v3/roles => generated 219 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:10.553833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e6e03-f800-48f7-a9a1-bde2504fe01b None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.554375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e6e03-f800-48f7-a9a1-bde2504fe01b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.554919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e6e03-f800-48f7-a9a1-bde2504fe01b None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.556525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 17/32] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:10.557514 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e6e03-f800-48f7-a9a1-bde2504fe01b None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:10.621221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 16/33] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:10.623548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.624067 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.624597 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.661694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:10.663511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:10.699702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e6e03-f800-48f7-a9a1-bde2504fe01b None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:10.744101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:10.744998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:10.745329 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:10.746257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] PATH_INFO: `/v3/domains/default/users/5c3cc6fae8b64bde852a1c9bdb227ae0/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:10.749161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c3cc6fae8b64bde852a1c9bdb227ae0, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:10.751990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:10.773388 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 18/34] 10.222.0.71 () {58 vars in 1361 bytes} [Thu May 19 14:50:10 2022] PUT /identity/v3/domains/default/users/5c3cc6fae8b64bde852a1c9bdb227ae0/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:10.780151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:10.838965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 17/35] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:10.891219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:10.899191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:10.973483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec9c4-269f-4c9e-8d5f-72580f1866e0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:11.015748 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:11.016379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.016681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.016975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.017761 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:11.019244 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:11.040132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 19/36] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:50:10 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:11.128180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818c868-a9ff-4731-9741-e62ef008c77e None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:11.131314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:11.173134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:11.174077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.174368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.174648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.188373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:11.189987 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:50:11.210235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:11.211330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:11.213144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:50:11.213144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:50:11.213144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:11.213144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:11.213144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 18/37] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:11.218042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:11.348572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433b36c-e025-4546-a706-7a25d393d4f7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:11.364091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:11.388699 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:11.389392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.389689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.389989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.390761 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:11.391114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:11.392609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84648a0-4b57-42eb-b1df-a09f48d888a3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:11.413283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:11.419651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:11.515651 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841895d-7152-4401-b44c-545e5d64dcc0 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.516017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841895d-7152-4401-b44c-545e5d64dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.516252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841895d-7152-4401-b44c-545e5d64dcc0 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.517662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 21/39] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:11.524172 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475e1a-c4cc-4748-8b82-9036c6e98291 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.524455 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475e1a-c4cc-4748-8b82-9036c6e98291 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.524747 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475e1a-c4cc-4748-8b82-9036c6e98291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.544676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-ee475e1a-c4cc-4748-8b82-9036c6e98291 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:11.546371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-ee475e1a-c4cc-4748-8b82-9036c6e98291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:11.560861 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37007127-c74c-4c44-bd4e-32f5a1484770 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:11.606313 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:11.606956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.607253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.607982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.608881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:11.610680 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:11.628543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 22/40] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:11.630240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5102f7c-2c13-47c5-bac1-9e78426a86c2 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.630545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5102f7c-2c13-47c5-bac1-9e78426a86c2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.631235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5102f7c-2c13-47c5-bac1-9e78426a86c2 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.636431 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 23/41] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:11.637598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.637899 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.638349 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.656651 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:11.658383 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:11.727465 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 24/42] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:11.739154 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:11.757573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 19/43] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:50:11 2022] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:11.758588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:11.775210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:11.790464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:11.875243 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba698c-8c59-4152-b245-4791984d1213 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:11.915413 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884d2e-1144-49c9-aa0a-43aadba83781 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:11.916513 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:11.917409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.917785 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.918245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.919203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:11.920737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:11.939496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 25/44] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:50:11 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:11.974157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63c9ef-6c5d-45dd-8f16-d66c14ee6ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:11.975044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c9ef-6c5d-45dd-8f16-d66c14ee6ba0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:11.975343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c9ef-6c5d-45dd-8f16-d66c14ee6ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:11.975634 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c9ef-6c5d-45dd-8f16-d66c14ee6ba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:11.977128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c9ef-6c5d-45dd-8f16-d66c14ee6ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:11.978941 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c9ef-6c5d-45dd-8f16-d66c14ee6ba0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:11.981920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 20/45] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:11.987784 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:12.112457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:12.122008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a706d-59ed-4ee5-8962-611d09cff059 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:12.164220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972eb1-ac75-422c-877b-8ac9588d3ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:12.164835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972eb1-ac75-422c-877b-8ac9588d3ac1 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:12.165133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972eb1-ac75-422c-877b-8ac9588d3ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:12.165420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972eb1-ac75-422c-877b-8ac9588d3ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:12.166148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972eb1-ac75-422c-877b-8ac9588d3ac1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:12.167755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972eb1-ac75-422c-877b-8ac9588d3ac1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:12.197535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 26/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:50:11 2022] POST /identity/v3/projects => generated 312 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:13.354990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09a45-aa3d-4921-8b21-a5a621d211de None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:13.355643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09a45-aa3d-4921-8b21-a5a621d211de None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:13.355643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09a45-aa3d-4921-8b21-a5a621d211de None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:13.356893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 21/47] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:13.362315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:13.362813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:13.362978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:13.379918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:13.381109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:13.449665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 27/48] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:13.472751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d09a45-aa3d-4921-8b21-a5a621d211de None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:13.551567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:13.576216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d09a45-aa3d-4921-8b21-a5a621d211de None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:13.611864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:13.612561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:13.612897 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:13.613183 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:13.625653 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:13.634416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:13.635684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:13.637337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 22/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:13.644166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:13.718158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:13.741605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c65e8-887c-4a1a-9f72-476b52cd73dc None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:13.774616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:13.775319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:13.775610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:13.775893 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:13.777255 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:13.778757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:13.780213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:13.791832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 28/50] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:13.797460 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:13.897468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6269d1-887d-47dc-a0c6-571ce05ccfa1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:13.933674 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:13.934619 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:13.934943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:13.935230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:13.936778 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:13.938449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:13.940357 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 23/51] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:13 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:13.945509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:14.048633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be095-c8f9-4ca0-83eb-34bc6a9b0e2c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:14.083479 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cd246-0abd-4ddf-89f9-3ca04199cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:14.084287 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cd246-0abd-4ddf-89f9-3ca04199cdfb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:14.084583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cd246-0abd-4ddf-89f9-3ca04199cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:14.084871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cd246-0abd-4ddf-89f9-3ca04199cdfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:14.086098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cd246-0abd-4ddf-89f9-3ca04199cdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:14.087646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cd246-0abd-4ddf-89f9-3ca04199cdfb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:14.089340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 29/52] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:14.095572 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:14.100119 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:14.197544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed2ea-05c7-48ba-9bfa-2f425f3cb888 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:14.231814 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:14.232481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:14.232778 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:14.233068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:14.233924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.domain.id=default, user.id=5c3cc6fae8b64bde852a1c9bdb227ae0) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:14.234247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:14.235818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32780-2601-4a6c-8fa6-dbd5a2af3f4f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:14.244550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 24/53] 10.222.0.71 () {56 vars in 1322 bytes} [Thu May 19 14:50:14 2022] GET /identity/v3/role_assignments?user.id=5c3cc6fae8b64bde852a1c9bdb227ae0&scope.domain.id=default&role.id=40636a8261d645b6a2041281c7044370 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:14.455176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4305c-1ccc-4287-90ea-36cdce2a0eaa None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:14.455692 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4305c-1ccc-4287-90ea-36cdce2a0eaa None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:14.455692 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4305c-1ccc-4287-90ea-36cdce2a0eaa None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:14.457058 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 30/54] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:14.462455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:14.462925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:14.463069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:14.481224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:14.482762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:14.544163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:14.549789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 25/55] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:14.574177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4305c-1ccc-4287-90ea-36cdce2a0eaa None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:14.583598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:14.675219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4305c-1ccc-4287-90ea-36cdce2a0eaa None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:14.708230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399847-15bd-46c3-a1c3-b1eee6216e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:14.708955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399847-15bd-46c3-a1c3-b1eee6216e58 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:14.709245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399847-15bd-46c3-a1c3-b1eee6216e58 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:14.709525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399847-15bd-46c3-a1c3-b1eee6216e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:14.710702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399847-15bd-46c3-a1c3-b1eee6216e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:14.712208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399847-15bd-46c3-a1c3-b1eee6216e58 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:14.713813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 31/56] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:14.720131 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:14.815835 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b528-4d53-417f-884b-bddf51a45a57 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:14.848936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3e18d-1a8f-41c2-bf21-1a1505e399b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:14.849590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3e18d-1a8f-41c2-bf21-1a1505e399b5 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:14.849878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3e18d-1a8f-41c2-bf21-1a1505e399b5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:14.850159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3e18d-1a8f-41c2-bf21-1a1505e399b5 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:14.850905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3e18d-1a8f-41c2-bf21-1a1505e399b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:14.852353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3e18d-1a8f-41c2-bf21-1a1505e399b5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:14.876397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 26/57] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:50:14 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:17.070259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b16df0-9338-4e4a-a555-2123bc3a38d8 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:17.070750 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b16df0-9338-4e4a-a555-2123bc3a38d8 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:17.070898 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b16df0-9338-4e4a-a555-2123bc3a38d8 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:17.072282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 32/58] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:17.077565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:17.078010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:17.078140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:17.095692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:17.096892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:17.143594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:17.165945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 27/59] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:17.190768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b16df0-9338-4e4a-a555-2123bc3a38d8 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:17.267928 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:17.293883 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b16df0-9338-4e4a-a555-2123bc3a38d8 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:17.326927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d7153-8081-4509-b30c-90eb2677f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:17.327725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7153-8081-4509-b30c-90eb2677f26f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:17.328023 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7153-8081-4509-b30c-90eb2677f26f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:17.328314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7153-8081-4509-b30c-90eb2677f26f None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:17.329515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d7153-8081-4509-b30c-90eb2677f26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:17.331020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d7153-8081-4509-b30c-90eb2677f26f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:17.332652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 33/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:17.338235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:17.435732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd3bd-6ab1-44fc-953a-33d1534a8b55 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:17.469868 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66c82-e733-4ecc-ba8a-53446158e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:17.470547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66c82-e733-4ecc-ba8a-53446158e355 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:17.470870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66c82-e733-4ecc-ba8a-53446158e355 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:17.471164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66c82-e733-4ecc-ba8a-53446158e355 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:17.471898 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66c82-e733-4ecc-ba8a-53446158e355 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:17.473360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66c82-e733-4ecc-ba8a-53446158e355 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:17.497546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 28/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:17 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:20.717875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433872f-94cc-485b-8f85-18f1c1afed8f None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:20.717875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433872f-94cc-485b-8f85-18f1c1afed8f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:20.717875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433872f-94cc-485b-8f85-18f1c1afed8f None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:20.717875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 34/62] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:20.724191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb9be-c228-4cbe-89cd-a0a79828cffd None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:20.724960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb9be-c228-4cbe-89cd-a0a79828cffd None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:20.725425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb9be-c228-4cbe-89cd-a0a79828cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:20.751786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-6eddb9be-c228-4cbe-89cd-a0a79828cffd None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:20.753248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-6eddb9be-c228-4cbe-89cd-a0a79828cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:20.788793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:20.853030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 29/63] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:20.889454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433872f-94cc-485b-8f85-18f1c1afed8f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.025510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433872f-94cc-485b-8f85-18f1c1afed8f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.036504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08421d-3fb0-42a1-bbc3-cfc5ee106267 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.036790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08421d-3fb0-42a1-bbc3-cfc5ee106267 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.037277 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08421d-3fb0-42a1-bbc3-cfc5ee106267 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.038863 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 30/64] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:21.045335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.045634 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.045927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.071456 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:21.076379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:21.106889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.108127 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.108643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.109155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.130159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:21.146821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:21.147900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:21.148822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:21.152393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 35/65] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:21.158326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.162718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.175785 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 31/66] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:21.195072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.308344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27d074-3e6d-4f02-867a-c368ec791b50 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.339899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.347136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.348254 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.349252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.351135 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.351573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3fe1-2ed6-4107-8e78-81b294924f3d None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.352462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:21.353027 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:21.354933 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4750-99d9-4fb2-a92f-9b8ba2c37a82 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:21.366295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 36/67] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:21.368526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5011-fe6b-460b-9d39-eb725709ce1d None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.369076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5011-fe6b-460b-9d39-eb725709ce1d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.370470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5011-fe6b-460b-9d39-eb725709ce1d None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.372425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 37/68] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:21.373457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5011-fe6b-460b-9d39-eb725709ce1d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.412862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7814e0-7a56-49eb-af20-eceb2c4df5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.413680 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7814e0-7a56-49eb-af20-eceb2c4df5cd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.413973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7814e0-7a56-49eb-af20-eceb2c4df5cd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.414260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7814e0-7a56-49eb-af20-eceb2c4df5cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.427882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7814e0-7a56-49eb-af20-eceb2c4df5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-2a7814e0-7a56-49eb-af20-eceb2c4df5cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:21.438216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:21.439338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:21.440343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 32/69] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:21.441126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.441423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.441904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.461427 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.465871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:21.469448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:21.513915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5011-fe6b-460b-9d39-eb725709ce1d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.552475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 33/70] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:21.553782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.559699 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.560558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.560850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.561136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.591966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:21.593470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:21.595817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 38/71] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:21.600979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.650942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.668447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb150476-3b66-4b37-9e01-9c338ee263ca None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.711711 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.712402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.712696 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.712985 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.713756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:21.714078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:21.715529 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:21.724739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 34/72] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:21.726211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.742408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e0be-fab9-48ec-99b1-843bc6ffe60b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.765656 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.777369 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1ea96-98f0-4951-a952-bef228f4d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.778037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1ea96-98f0-4951-a952-bef228f4d0ab None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.778331 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1ea96-98f0-4951-a952-bef228f4d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.778621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1ea96-98f0-4951-a952-bef228f4d0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.828914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84c7e-4bf6-4562-a323-facaceb4656f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:21.849829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1ea96-98f0-4951-a952-bef228f4d0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:21.851410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1ea96-98f0-4951-a952-bef228f4d0ab None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:21.862722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1ee1-50f6-40b8-b190-3402321469e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:21.863567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1ee1-50f6-40b8-b190-3402321469e3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.863855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1ee1-50f6-40b8-b190-3402321469e3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.864141 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1ee1-50f6-40b8-b190-3402321469e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.874733 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa1ee1-50f6-40b8-b190-3402321469e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-30fa1ee1-50f6-40b8-b190-3402321469e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:21.882774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:21.883934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:21.884850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 35/73] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:21.886213 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239585e-9589-4d5e-bc96-ded2314e8b68 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.886296 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239585e-9589-4d5e-bc96-ded2314e8b68 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.886583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239585e-9589-4d5e-bc96-ded2314e8b68 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.887885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 36/74] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:21.888800 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239585e-9589-4d5e-bc96-ded2314e8b68 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:21.900547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.954054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 39/75] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:21.954054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949efb4-a83f-4c28-bec2-3a80368a3e05 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.954054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949efb4-a83f-4c28-bec2-3a80368a3e05 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.954054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949efb4-a83f-4c28-bec2-3a80368a3e05 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.954054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 40/76] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:21.954054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:21.959305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:21.959305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:21.975956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:21.977168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:21.993971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:21.995517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239585e-9589-4d5e-bc96-ded2314e8b68 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.044508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.044508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.044508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.044961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.046315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.047884 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.049613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 37/77] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:21 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:22.049613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.059695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 41/78] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:22.060545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.137962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.161204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e630b36-e91f-4059-9412-c2214da194bf None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.161376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077faf09-7ebd-4e71-824c-f97dee675dd6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.194291 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad499a2-3350-4d5d-8f57-9781a7bf6981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.195027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.195189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad499a2-3350-4d5d-8f57-9781a7bf6981 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.195731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad499a2-3350-4d5d-8f57-9781a7bf6981 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.195844 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.196022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad499a2-3350-4d5d-8f57-9781a7bf6981 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.196136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.196311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.197083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:22.197228 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad499a2-3350-4d5d-8f57-9781a7bf6981 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.197405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.199309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad499a2-3350-4d5d-8f57-9781a7bf6981 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.199445 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.201014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 42/79] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:22.202167 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.202456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.202740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.216925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 38/80] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:22.216925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.223154 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:22.224374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:22.238749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.291791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 43/81] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:22.292639 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.312625 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23242c8-19c0-463b-9baa-1fe42a2ca677 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.347197 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.347863 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.348153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.348446 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.356953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.401512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af0a96-e2bd-4318-928d-4c6cfa629a8c None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.418368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.419902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.438972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.439791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.440083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.440368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.441574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.443075 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.444726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 44/82] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:22.445508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.464026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.526892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 39/83] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:22.527759 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.549601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635a67-73c5-4d43-91d8-227ba3f473c1 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.568126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.583369 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.584108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.584407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.584689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.585530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=86a02799f2554ebd84af7b73acccf48f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:22.585849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.587378 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.592942 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 45/84] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/role_assignments?user.id=86a02799f2554ebd84af7b73acccf48f&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:22.593728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.638855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468419-0c5b-47a1-b64c-99822b0eb861 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.675647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.676469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.676759 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.677048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.678352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.679883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.681622 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 40/85] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:22.682444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.710434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.732495 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44a36d-3670-43c2-aa2f-6fff62f79a4b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.771441 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.772751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.773052 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.773343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.786110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:22.794128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:22.795225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:22.796936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 46/86] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:22.800849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.805269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22565068-ee49-479e-afac-574aa75a8f67 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:22.814425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:22.845615 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:22.846315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:22.846609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:22.846932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:22.847669 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:22.849144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:22.870465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 41/87] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:22 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:22.871398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:22.941822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd0b9e-f4e6-4821-a4a6-82de87237d94 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.011022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.011934 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.012232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.012520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.015665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.017184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.019473 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 47/88] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:23.021241 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:23.038695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:23.041718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e1cf4-8f1c-4926-87f4-dc8d8c7a8a08 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.096984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.097813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.098114 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.098624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.137950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:23.155467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3622f3-73e6-404d-a052-b84aecf5dfe0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.189718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.191379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.199576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.200215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.200514 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.200803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.201582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:23.201906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.205165 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.217724 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 48/89] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:23.218398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:23.303722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:23.323445 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 42/90] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:23.324721 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:23.352375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517287ee-a929-4a80-ae4e-9e4659011553 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.397294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.397988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.398288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.398580 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.399484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=5c3cc6fae8b64bde852a1c9bdb227ae0) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:23.399812 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.401328 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.410179 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 49/91] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/role_assignments?user.id=5c3cc6fae8b64bde852a1c9bdb227ae0&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:23.411568 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:23.411721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:23.463574 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45a73-78db-4bc1-a27d-064a5d3d6fb6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.503643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.504973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.505484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.506020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.507560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.509263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.512303 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 43/92] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:23.519089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:23.566831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151e68-30af-48f5-a66d-764a39088e13 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.607404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.608851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.609384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.609904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.611406 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.613132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.615277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 50/93] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:23.622082 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:23.628401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:23.650557 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cfe0e-4cec-42f7-87fd-f92e73c4e285 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.684194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:23.691400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.692069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.692382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.692703 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.750587 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec8e8-33ea-44c7-a50c-350c92e90d98 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:23.772579 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.774461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.789941 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:23.791385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:23.791938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:23.792444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:23.793572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] RBAC: Adding query filter params (role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=86a02799f2554ebd84af7b73acccf48f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:23.794141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:23.795944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:23.802974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 51/94] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/role_assignments?user.id=86a02799f2554ebd84af7b73acccf48f&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:23.904253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 44/95] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:50:23.910117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:24.012576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:24.062755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d3da5-d7ca-4bc6-b566-6b4dc92ece95 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:24.111627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f76bb8-d3a7-446c-bb4a-d691a1e067d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:24.112578 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76bb8-d3a7-446c-bb4a-d691a1e067d5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:24.112874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76bb8-d3a7-446c-bb4a-d691a1e067d5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:24.113160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76bb8-d3a7-446c-bb4a-d691a1e067d5 None admin] PATH_INFO: `/v3/projects/488bf30d013f47d5a2d00bc41d539a37` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:24.119590 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f76bb8-d3a7-446c-bb4a-d691a1e067d5 None admin] RBAC: Authorizing `identity:get_project(project_id=488bf30d013f47d5a2d00bc41d539a37)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:24.121756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f76bb8-d3a7-446c-bb4a-d691a1e067d5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:24.123762 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 52/96] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:23 2022] GET /identity/v3/projects/488bf30d013f47d5a2d00bc41d539a37 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:24.129925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:24.165691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:24.259315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a870b-b6d9-431a-b48d-d7d3370b140b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:24.310588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:24.311218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:24.311509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:24.311794 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:24.312656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=488bf30d013f47d5a2d00bc41d539a37, user.id=86a02799f2554ebd84af7b73acccf48f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:24.312979 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:24.314453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b465d-3fd4-45ec-9fba-6b6a9a1a0e15 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:24.321612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 45/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:24 2022] GET /identity/v3/role_assignments?user.id=86a02799f2554ebd84af7b73acccf48f&scope.project.id=488bf30d013f47d5a2d00bc41d539a37&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:25.553333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40f14-bf02-4b2e-b1f4-a49d282d8f06 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:25.553894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40f14-bf02-4b2e-b1f4-a49d282d8f06 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:25.553894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40f14-bf02-4b2e-b1f4-a49d282d8f06 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:25.555480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 53/98] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:25.573395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:25.573986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:25.573986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:25.595774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:25.596980 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:25.684202 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 46/99] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:25.732419 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf40f14-bf02-4b2e-b1f4-a49d282d8f06 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:25.866337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf40f14-bf02-4b2e-b1f4-a49d282d8f06 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:25.916662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3be7b-6294-4c2d-b47a-6e61319f8938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:25.918141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3be7b-6294-4c2d-b47a-6e61319f8938 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:25.918432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3be7b-6294-4c2d-b47a-6e61319f8938 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:25.918717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3be7b-6294-4c2d-b47a-6e61319f8938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:25.925334 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:25.939722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3be7b-6294-4c2d-b47a-6e61319f8938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-74a3be7b-6294-4c2d-b47a-6e61319f8938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:25.950067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:25.951147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:25.952464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 54/100] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:25.959376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:25.990853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:26.051254 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28817303-3fb9-4cda-af3a-496811dc70f4 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:26.051547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28817303-3fb9-4cda-af3a-496811dc70f4 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:26.052124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28817303-3fb9-4cda-af3a-496811dc70f4 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:26.053965 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 55/101] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:26.059402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:26.059922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:26.060412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:26.093265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:26.094854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:26.135929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e627b-92b3-41eb-8b89-a42895808d43 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:26.264360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:26.265459 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:26.266261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:26.266744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:26.267417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 56/102] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:26.267990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] RBAC: Adding query filter params (name=member) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:26.268511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:26.278813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:26.290637 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 47/103] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:26.297295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:26.306113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:26.479113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:26.505132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308c0b-8bf1-4af6-9271-9d84c9ccd46f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:26.512811 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95034c6c-fb67-4e0a-91a3-5f83623239b8 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:26.570098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:26.607636 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:26.608892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:26.609328 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:26.609818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:26.612919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:26.614609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:26.616921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 57/104] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:26 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:26.632727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:26.672249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:26.672838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:26.673404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:26.673404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:26.728121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:26.740443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:26.741527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:26.742476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 48/105] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:26.764628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:26.984223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cef82-9a30-49a7-af96-442c2d2903e0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.053161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417da8c-8c3c-41b9-ae11-8b85a2bc8c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.054042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417da8c-8c3c-41b9-ae11-8b85a2bc8c1f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.054331 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417da8c-8c3c-41b9-ae11-8b85a2bc8c1f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.054612 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417da8c-8c3c-41b9-ae11-8b85a2bc8c1f None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.056849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417da8c-8c3c-41b9-ae11-8b85a2bc8c1f None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:27.059819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417da8c-8c3c-41b9-ae11-8b85a2bc8c1f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:27.063084 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 58/106] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:26 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:27.064312 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ab24b-91cd-4788-8a6f-b400d5a177ea None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.064605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ab24b-91cd-4788-8a6f-b400d5a177ea None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.064888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ab24b-91cd-4788-8a6f-b400d5a177ea None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.067513 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 59/107] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:27.070573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907261a-2f98-42ce-9809-d2cbdf34bcc8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.074202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ab24b-91cd-4788-8a6f-b400d5a177ea None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:27.133525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.137466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.137922 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.140725 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.144702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:27.144702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:27.144702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2ecd2-8e7b-40f4-81d1-5dffa0ad9c7c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:27.153686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 49/108] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:27.155311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.155879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.156409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.187206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:27.188823 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:27.192349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:27.194570 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:27.251127 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ab24b-91cd-4788-8a6f-b400d5a177ea None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.292032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 50/109] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:27.292821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:27.295753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fd94-563f-4c04-a535-9f6e255f0b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.297765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fd94-563f-4c04-a535-9f6e255f0b28 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.298271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fd94-563f-4c04-a535-9f6e255f0b28 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.298838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fd94-563f-4c04-a535-9f6e255f0b28 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/86a02799f2554ebd84af7b73acccf48f/roles/8fed1fbe1c3540dfa086071e3ef21c4e` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.301721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fd94-563f-4c04-a535-9f6e255f0b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=94f3cc6e099b4963a5a093333b5f04ba, user_id=86a02799f2554ebd84af7b73acccf48f, role_id=8fed1fbe1c3540dfa086071e3ef21c4e)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:27.303916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fd94-563f-4c04-a535-9f6e255f0b28 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:27.332075 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 60/110] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:27 2022] PUT /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/86a02799f2554ebd84af7b73acccf48f/roles/8fed1fbe1c3540dfa086071e3ef21c4e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:27.333298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27490f9-53e7-42ae-8998-e09eb5b19ac2 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.333666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27490f9-53e7-42ae-8998-e09eb5b19ac2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.334014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27490f9-53e7-42ae-8998-e09eb5b19ac2 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.335622 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 61/111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:27.336314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27490f9-53e7-42ae-8998-e09eb5b19ac2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:27.433157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d233d-7a71-4586-8189-e43e470f6247 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.483929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542767-bbcf-4c18-b2e5-97a10f3fcc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.484836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542767-bbcf-4c18-b2e5-97a10f3fcc56 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.485124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542767-bbcf-4c18-b2e5-97a10f3fcc56 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.485421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542767-bbcf-4c18-b2e5-97a10f3fcc56 None admin] PATH_INFO: `/v3/users/91920df9ecb44e078b6b7858531f778c` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.495413 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:27.507851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27490f9-53e7-42ae-8998-e09eb5b19ac2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.508649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2542767-bbcf-4c18-b2e5-97a10f3fcc56 None admin] RBAC: Authorizing `identity:get_user(user_id=91920df9ecb44e078b6b7858531f778c)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:27.510468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2542767-bbcf-4c18-b2e5-97a10f3fcc56 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:27.512632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 51/112] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:27 2022] GET /identity/v3/users/91920df9ecb44e078b6b7858531f778c => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:27.514177 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.514550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.514928 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.541472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:27.543665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:27.545154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:27.560484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a4449-4f22-4a4c-a5ef-d99acda4db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.561357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a4449-4f22-4a4c-a5ef-d99acda4db0e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.561653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a4449-4f22-4a4c-a5ef-d99acda4db0e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.561937 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a4449-4f22-4a4c-a5ef-d99acda4db0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.574386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a4449-4f22-4a4c-a5ef-d99acda4db0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-6c0a4449-4f22-4a4c-a5ef-d99acda4db0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:27.582543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:27.583727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:27.584742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 62/113] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:27.585663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb9c6-1775-4763-af66-285abc8dc233 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.585663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb9c6-1775-4763-af66-285abc8dc233 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.586454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb9c6-1775-4763-af66-285abc8dc233 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.587642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 63/114] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:27.588957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb9c6-1775-4763-af66-285abc8dc233 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:27.638100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 52/115] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:27.639852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:27.705639 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb9c6-1775-4763-af66-285abc8dc233 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.754821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.755636 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.755934 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.756222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.774934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185c4a-d476-4593-a06a-1802d3fe3cd1 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:27.804453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:27.814682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:27.816972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:27.818683 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.819292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.822686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.822686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:27.822686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:27.822686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf51fa-ef9e-4e08-8152-6fa749da7c29 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:27.834094 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 53/116] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:27.835666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:27.836186 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:27.836701 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:27.840293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:27.842174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:27.856351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:27.857996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:27.931304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 54/117] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:27.932576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:27.963960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 64/118] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:27.964639 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.051665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.058376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf585b-14c9-4e8e-9065-21091e1cb076 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.071398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7707f2-370f-4840-bd75-24476b02e921 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.077913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.098536 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1325-62c5-4965-aed0-23fac04ef8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.099398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1325-62c5-4965-aed0-23fac04ef8ac None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.099726 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1325-62c5-4965-aed0-23fac04ef8ac None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.100048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1325-62c5-4965-aed0-23fac04ef8ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.101260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e1325-62c5-4965-aed0-23fac04ef8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.102955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e1325-62c5-4965-aed0-23fac04ef8ac None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.104721 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 55/119] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:28.105686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cf7e1-b624-4d56-918b-7119fc352942 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.106012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cf7e1-b624-4d56-918b-7119fc352942 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.106317 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cf7e1-b624-4d56-918b-7119fc352942 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.107848 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 56/120] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:28.108587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cf7e1-b624-4d56-918b-7119fc352942 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.110888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.113164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.113493 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.113791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.115105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.116593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.118769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 65/121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:27 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:28.123000 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.222530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cf7e1-b624-4d56-918b-7119fc352942 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.236641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48de20-6c40-4c3a-91e6-32057c571f78 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.259343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.260204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.260503 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.260793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.271862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:28.279580 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d52e7-e486-4079-b27a-d356b965dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.280469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d52e7-e486-4079-b27a-d356b965dd41 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.280767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d52e7-e486-4079-b27a-d356b965dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:28.280885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:28.281871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:28.282919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:28.283654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d52e7-e486-4079-b27a-d356b965dd41 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.283745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 57/122] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:28.283745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.284905 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d52e7-e486-4079-b27a-d356b965dd41 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.286410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d52e7-e486-4079-b27a-d356b965dd41 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.288209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 66/123] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:28.289401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.289699 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.289989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.308063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:28.309396 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:28.325142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.344307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.388637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 67/124] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:28.389492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.412911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375062-bf72-4240-9a7c-e678647c8bea None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.448517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.449192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.449481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.449775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.450481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.451987 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.479853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 58/125] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:50:28 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:28.480559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.517497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fe575-44a5-4a18-a428-6a574a3b1ce6 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.559159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.560404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.560715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.561083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.562458 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.564253 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.566245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 68/126] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:28.571661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.592567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.596882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb493b-bb6a-46ab-8fe3-757e0d90600e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.603262 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.641497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.642292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.642654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.643057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.643919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:28.644315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.645839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.656332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 59/127] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:28.657313 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.710232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33a20b-244f-462b-a508-b629f536de07 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.753858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.754539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.754867 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.755163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.756513 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] RBAC: Adding query filter params (role.id=99e96b0a95f54e22931046dc4da12b0a, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=91920df9ecb44e078b6b7858531f778c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:28.756848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:28.758621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:28.767688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 69/128] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/role_assignments?user.id=91920df9ecb44e078b6b7858531f778c&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=99e96b0a95f54e22931046dc4da12b0a => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:28.768504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.769429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc8ef8-8a37-4f5a-a3e9-b18f41c6e3ef None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:28.815403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:28.816200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:28.816483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:28.816767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:28.832118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:28.840905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:28.842348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 60/129] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:28.844005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:28.893664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.911503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:28.982666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bd213-2ad5-4c93-976b-159b4c430a66 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.005485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b33d8-d2ca-4b05-96cf-d085e75e3341 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.051598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.052500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.052796 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.053083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.058215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.062238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.063995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 61/130] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:28 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:29.064780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:29.079834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.080678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.080975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.091707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/5c3cc6fae8b64bde852a1c9bdb227ae0/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.094208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=94f3cc6e099b4963a5a093333b5f04ba, user_id=5c3cc6fae8b64bde852a1c9bdb227ae0, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.095738 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.140020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 70/131] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:28 2022] PUT /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/5c3cc6fae8b64bde852a1c9bdb227ae0/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:29.140614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:29.227363 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:29.245664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef329e2a-7f66-49a5-b2ac-d58911001a49 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.291845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.293057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.293577 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.294098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.295133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] RBAC: Adding query filter params (name=member) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:29.295664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.297276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.318150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 62/132] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:29.324115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:29.405940 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65a4e6-c23d-4fa3-a0b5-db1ce795d4f4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.455033 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bdec2-29cc-4a5d-900b-aefa99fd5b1b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.496724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.498028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.498547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.499092 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.500815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.502518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.504116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.504958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 63/133] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:29 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:29.505357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.505655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.505980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.511798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.512025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:29.513389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.515655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 71/134] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:29 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:29.521404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:29.543187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:29.564016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:29.677330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1b48-939b-4275-a3af-b84eba6154d7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.709674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2632a7-c570-4df2-8bd0-871912b1c9df None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.716468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.717684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.718191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.718696 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] PATH_INFO: `/v3/projects/488bf30d013f47d5a2d00bc41d539a37` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.720252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] RBAC: Authorizing `identity:get_project(project_id=488bf30d013f47d5a2d00bc41d539a37)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.721943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.723965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 64/135] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:29 2022] GET /identity/v3/projects/488bf30d013f47d5a2d00bc41d539a37 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:29.731885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:29.767195 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b485a-8cd9-43f8-87f5-e5b003351549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.768117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b485a-8cd9-43f8-87f5-e5b003351549 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.768411 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b485a-8cd9-43f8-87f5-e5b003351549 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.768700 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b485a-8cd9-43f8-87f5-e5b003351549 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/86a02799f2554ebd84af7b73acccf48f/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.773034 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b485a-8cd9-43f8-87f5-e5b003351549 None admin] RBAC: Authorizing `identity:create_grant(project_id=94f3cc6e099b4963a5a093333b5f04ba, user_id=86a02799f2554ebd84af7b73acccf48f, role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.774552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b485a-8cd9-43f8-87f5-e5b003351549 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:29.809753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 72/136] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:29 2022] PUT /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/86a02799f2554ebd84af7b73acccf48f/roles/b7343e07f3324924a8676c7aad3628d0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:50:29.881204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:29.887863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82e35-421f-4f87-91ee-4a5601fabaf2 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.888208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82e35-421f-4f87-91ee-4a5601fabaf2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.888462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82e35-421f-4f87-91ee-4a5601fabaf2 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.889888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 73/137] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:29.895621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.895926 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.896211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.899849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a43df-4c17-4d39-af5a-0935394946b7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:29.914350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:29.915621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:29.987203 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:29.988140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:29.988434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:29.988728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] PATH_INFO: `/v3/projects/488bf30d013f47d5a2d00bc41d539a37/users/86a02799f2554ebd84af7b73acccf48f/roles/8fed1fbe1c3540dfa086071e3ef21c4e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:29.992333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] RBAC: Authorizing `identity:create_grant(project_id=488bf30d013f47d5a2d00bc41d539a37, user_id=86a02799f2554ebd84af7b73acccf48f, role_id=8fed1fbe1c3540dfa086071e3ef21c4e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:29.993823 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:30.006042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:30.013372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 74/138] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:30.036121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 65/139] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:29 2022] PUT /identity/v3/projects/488bf30d013f47d5a2d00bc41d539a37/users/86a02799f2554ebd84af7b73acccf48f/roles/8fed1fbe1c3540dfa086071e3ef21c4e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:30.064395 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:30.209238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1554ae1-9ad2-4d17-b080-dd1051608a61 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:30.264756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:30.265498 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:30.265794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:30.266073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:30.282172 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:30.290159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:30.291277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:30.292199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 75/140] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:30.297610 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:30.435332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe04742-731d-456c-abcb-c7e9ef5d5efd None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:30.472886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:30.473585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:30.473882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:30.474174 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:30.474986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] RBAC: Adding query filter params (name=member) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:30.475311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:30.476735 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:30.487135 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 66/141] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:30.492739 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:30.561418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:30.607793 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc48f-04e3-4456-afd4-81ed72d12f81 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:30.647913 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:30.648879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:30.649224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:30.649517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:30.651373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:30.652875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:30.654552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 76/142] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:30 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:30.660282 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:30.676998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:30.795670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a985446-e695-4a91-9b37-718fcdc82f76 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:30.844168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:30.844765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:30.845064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:30.845356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:30.922886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:30.924392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:30.934403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:31.053187 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 67/143] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:31.061220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:31.230685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c27d5a-1f98-4b61-b72d-e7f9076955d7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:31.273840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:31.285034 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55de86-5005-424f-b898-8d15d9b715a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:31.285923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55de86-5005-424f-b898-8d15d9b715a2 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:31.286218 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55de86-5005-424f-b898-8d15d9b715a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:31.286505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55de86-5005-424f-b898-8d15d9b715a2 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:31.287782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55de86-5005-424f-b898-8d15d9b715a2 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:31.289261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55de86-5005-424f-b898-8d15d9b715a2 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:31.291033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 77/144] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:31 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:31.297029 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:31.427096 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb6ab-71f8-4cb5-96a1-d40e165a819e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:31.437983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:31.474023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:31.474709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:31.475032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:31.475329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:31.476190 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=86a02799f2554ebd84af7b73acccf48f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:31.476515 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:31.477998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34506d-8f3c-466b-bbc3-10779a2d955e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:31.485483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 68/145] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:31 2022] GET /identity/v3/role_assignments?user.id=86a02799f2554ebd84af7b73acccf48f&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:31.699860 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc894-0a5b-4a37-af71-18a24e1fa5c4 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:31.700593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc894-0a5b-4a37-af71-18a24e1fa5c4 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:31.701129 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc894-0a5b-4a37-af71-18a24e1fa5c4 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:31.703136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 78/146] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:31.708545 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:31.708846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:31.709133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:31.735336 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:31.736639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:31.825720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 69/147] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:31.868076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc894-0a5b-4a37-af71-18a24e1fa5c4 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:32.008767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc894-0a5b-4a37-af71-18a24e1fa5c4 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:32.060501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125e57d-a743-465f-8483-429b1d5905c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:32.061727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125e57d-a743-465f-8483-429b1d5905c9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.062659 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125e57d-a743-465f-8483-429b1d5905c9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.063179 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125e57d-a743-465f-8483-429b1d5905c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.067522 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125e57d-a743-465f-8483-429b1d5905c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:32.069277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125e57d-a743-465f-8483-429b1d5905c9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:32.071560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 79/148] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:32.077095 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:32.131552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736539-dbfc-4f95-961b-31256712f29b None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.132222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736539-dbfc-4f95-961b-31256712f29b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.132737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736539-dbfc-4f95-961b-31256712f29b None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.134334 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 80/149] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:32.139517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.140096 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.140585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.164494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:32.166207 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:32.259193 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:32.278924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 81/150] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:32.293285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dcef-3aef-4f0f-993b-b97bf86a7fd6 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:32.295171 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:32.301548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:32.375022 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:32.375722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.376015 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.376305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.377046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:32.378522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:32.420015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e599243-08e1-41dc-899b-b4443cd83cd9 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:32.452154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 70/151] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:32 2022] POST /identity/v3/users => generated 283 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:32.467358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:32.468204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.468766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.491495 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:32.503753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:32.504993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:32.506650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 82/152] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:32.512003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:32.646557 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd06054-b5a9-470d-80f0-a3fd4e64ff23 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:32.692065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:32.692770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.693065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.693359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.694146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:32.694467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:32.695927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:32.708650 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 71/153] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:32.714103 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:32.798399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:32.857229 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196af7c2-8c97-483a-947c-91094f51f120 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:32.900873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b6f8e-9894-49f5-95e5-945c99d0e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:32.901774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6f8e-9894-49f5-95e5-945c99d0e31a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.902060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6f8e-9894-49f5-95e5-945c99d0e31a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.902338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6f8e-9894-49f5-95e5-945c99d0e31a None admin] PATH_INFO: `/v3/users/91920df9ecb44e078b6b7858531f778c` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.903614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b6f8e-9894-49f5-95e5-945c99d0e31a None admin] RBAC: Authorizing `identity:get_user(user_id=91920df9ecb44e078b6b7858531f778c)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:32.905101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b6f8e-9894-49f5-95e5-945c99d0e31a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:32.907086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 83/154] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:32 2022] GET /identity/v3/users/91920df9ecb44e078b6b7858531f778c => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:32.912204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:32.940087 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:32.945088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42479a6-5ec0-46e2-aca1-4a1a8addf8b1 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.945384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42479a6-5ec0-46e2-aca1-4a1a8addf8b1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.945675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42479a6-5ec0-46e2-aca1-4a1a8addf8b1 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.947298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 84/155] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:32.953418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:32.953720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:32.954008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:32.975262 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:32.976480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:33.069443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf47c3b-d4ba-40a3-b332-f31fad8d8160 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:33.084874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 85/156] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:33.115131 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:33.116012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.116308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.116597 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.117814 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:33.119889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:33.121957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 72/157] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:32 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:33.125261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.127231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.200193 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:33.278390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:33.289678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116323-b47e-4d61-86dc-27ee930855e3 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:33.295528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd184d2-db00-4c70-b3aa-2ca139239312 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:33.346489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:33.347737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.350225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.350744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/91920df9ecb44e078b6b7858531f778c/roles/99e96b0a95f54e22931046dc4da12b0a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.355192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] RBAC: Authorizing `identity:create_grant(project_id=94f3cc6e099b4963a5a093333b5f04ba, user_id=91920df9ecb44e078b6b7858531f778c, role_id=99e96b0a95f54e22931046dc4da12b0a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:33.357361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:33.362863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126b984-1cce-48b5-afaa-f73744fde429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:33.364025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126b984-1cce-48b5-afaa-f73744fde429 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.364551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126b984-1cce-48b5-afaa-f73744fde429 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.365029 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126b984-1cce-48b5-afaa-f73744fde429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.378264 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126b984-1cce-48b5-afaa-f73744fde429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:33.393304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 73/158] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:33 2022] PUT /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/users/91920df9ecb44e078b6b7858531f778c/roles/99e96b0a95f54e22931046dc4da12b0a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-4126b984-1cce-48b5-afaa-f73744fde429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:33.394409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:33.395534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:33.396492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:33.398963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 86/159] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:33.407328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.464841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125ea9-625a-4f74-89c2-ab2de7aa5f63 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.465384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125ea9-625a-4f74-89c2-ab2de7aa5f63 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.465862 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125ea9-625a-4f74-89c2-ab2de7aa5f63 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.468107 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 87/160] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:33.476495 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29038-885d-4e4a-bde4-0738a5b01f86 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.477200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29038-885d-4e4a-bde4-0738a5b01f86 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.477786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29038-885d-4e4a-bde4-0738a5b01f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.519598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-12b29038-885d-4e4a-bde4-0738a5b01f86 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:33.521330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-12b29038-885d-4e4a-bde4-0738a5b01f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:33.572824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b810-1ed6-4cd2-a8f3-8f01e4dfa03c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:33.622173 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 88/161] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:33.623599 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7dc5-9181-4c6f-976e-10400d156570 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.623974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7dc5-9181-4c6f-976e-10400d156570 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.624349 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7dc5-9181-4c6f-976e-10400d156570 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.625605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:33.626500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.626624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 89/162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:33.627145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.631064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.631943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:33.632313 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:33.633629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.633923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.634204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.636304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:33.651938 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 74/163] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:33.655107 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:33.656339 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:33.658112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.689329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:33.717447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:33.755826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 90/164] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:33.756724 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.804078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57656-9154-4dd2-ab38-a38eb350130a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:33.848895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:33.849905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.850200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.850475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] PATH_INFO: `/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.851919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] RBAC: Authorizing `identity:get_user(user_id=5c3cc6fae8b64bde852a1c9bdb227ae0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:33.853580 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:33.856415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 75/165] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:33 2022] GET /identity/v3/users/5c3cc6fae8b64bde852a1c9bdb227ae0 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:33.859725 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.891843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653a170-2d15-4970-bfa6-3e1d13c8fc4b None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:33.930164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:33.931038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:33.931329 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:33.931614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:33.943354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:33.954342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:33.955415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:33.956346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:33.958902 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 91/166] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:33.959759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:33.960322 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:34.016092 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ae95c-63a1-42f4-af6e-3bcf6569b933 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:34.049110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:34.092099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:34.092932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:34.093396 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:34.093685 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:34.115407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:34.124172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:34.125194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:34.126157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 76/167] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:34.127070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:34.225036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301bc12-2711-47c2-8bce-a837a73d8b64 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:34.304820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:34.305504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:34.305798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:34.306080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:34.386120 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae791b-9189-4ac8-9c75-6e65a060bc12 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:34.428295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:34.429828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:34.466381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:34.472960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:34.473662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:34.473951 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:34.474236 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:34.478325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:34.478325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:34.478325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:34.495056 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:34.501173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 77/168] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:34.502037 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:34.646597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 92/169] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:34.647523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:34.734974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161c2b-78a1-40c3-bd65-60140c8895ff None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:34.803530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:34.804227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:34.804517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:34.804969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:34.805751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] RBAC: Adding query filter params (name=member) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:34.806062 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:34.808028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:34.821809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 78/170] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:34.823286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:34.882809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94324ea2-b6d8-4f1e-8423-f901051f4232 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:34.939527 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:34.952088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:34.952999 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:34.953293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:34.953579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:34.959542 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:34.961051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:34.962700 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 93/171] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:34 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:34.964062 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:34.970471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:35.084772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042b057-a191-4743-89d5-837ed8565d26 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:35.125696 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9a134-1d87-45da-9bb4-dd2d4854e8be None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:35.168883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:35.169775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:35.170066 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:35.170346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:35.173374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:35.174890 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:35.176625 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 79/172] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:34 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:35.177513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:35.179516 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:35.180416 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:35.180709 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:35.180994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] PATH_INFO: `/v3/users/86a02799f2554ebd84af7b73acccf48f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:35.182299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] RBAC: Authorizing `identity:get_user(user_id=86a02799f2554ebd84af7b73acccf48f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:35.183805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:35.185740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 94/173] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:34 2022] GET /identity/v3/users/86a02799f2554ebd84af7b73acccf48f => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:35.186524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:35.299247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:35.345827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9cf4b-7400-4112-a341-f636d810844f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:35.408456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:35.409153 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:35.409447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:35.409736 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:35.410597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=5c3cc6fae8b64bde852a1c9bdb227ae0) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:35.410955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:35.412452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:35.426464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 95/174] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:35 2022] GET /identity/v3/role_assignments?user.id=5c3cc6fae8b64bde852a1c9bdb227ae0&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:35.427360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:35.449525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aafc8-3333-46dc-8eae-d224b5035247 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:35.536489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:35.555613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:35.556222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:35.556514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:35.557373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:35.584922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6975909-1221-4052-ac42-a9a0ed6bddd3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:35.627828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:35.640582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:35.641276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:35.641572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:35.641851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:35.724912 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:35.726418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:35.729280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:35.730813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:35.884626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 96/175] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:35.890847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:35.949001 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:35.977927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 80/176] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:35.983389 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:36.048040 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:36.055223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a67e4-8d5d-46ad-83ab-61cb5ebd1a50 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:36.134602 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b5613-205c-43ab-8d48-a968e55023a3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:36.153550 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:36.154358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.154647 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.154959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] PATH_INFO: `/v3/projects/488bf30d013f47d5a2d00bc41d539a37` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.156201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] RBAC: Authorizing `identity:get_project(project_id=488bf30d013f47d5a2d00bc41d539a37)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:36.157724 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:36.162116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 97/177] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:35 2022] GET /identity/v3/projects/488bf30d013f47d5a2d00bc41d539a37 => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:36.167870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:36.193900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:36.194815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.195112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.195395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.196644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:36.200828 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:36.202594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 81/178] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:35 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:36.210228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:36.371874 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f82e5-ab2f-4cec-ad2b-d045240e4a15 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:36.374154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:36.412499 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:36.413576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.414184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.414707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.416883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] RBAC: Adding query filter params (role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=86a02799f2554ebd84af7b73acccf48f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:36.417446 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:36.419825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd157-8a42-45ae-9900-3372053c0c74 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:36.431336 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 82/179] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:36 2022] GET /identity/v3/role_assignments?user.id=86a02799f2554ebd84af7b73acccf48f&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:36.463730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:36.476943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e00b-14cd-4c8f-87c7-c528ca906f7f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:36.523280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3ae5-b564-4e70-8f0d-b55909e65794 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.524230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3ae5-b564-4e70-8f0d-b55909e65794 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.524763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3ae5-b564-4e70-8f0d-b55909e65794 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.528019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 83/180] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:36.533545 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d2d0-2737-47b1-83e5-2af531195ee9 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.534177 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d2d0-2737-47b1-83e5-2af531195ee9 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.534682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d2d0-2737-47b1-83e5-2af531195ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.536003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:36.542456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.542456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.542456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.542456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=488bf30d013f47d5a2d00bc41d539a37, user.id=86a02799f2554ebd84af7b73acccf48f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:36.542456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:36.543002 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:36.555009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 98/181] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:36 2022] GET /identity/v3/role_assignments?user.id=86a02799f2554ebd84af7b73acccf48f&scope.project.id=488bf30d013f47d5a2d00bc41d539a37&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 608 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:36.572547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-c802d2d0-2737-47b1-83e5-2af531195ee9 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:36.574201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-c802d2d0-2737-47b1-83e5-2af531195ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:36.675349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 84/182] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:36.716682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:36.773794 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de5ae-f89e-456a-94df-6ae5473d842d None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.774479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de5ae-f89e-456a-94df-6ae5473d842d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.775027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de5ae-f89e-456a-94df-6ae5473d842d None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.777827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 85/183] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:36.785209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eb63-ff40-4f4d-a881-41520226e077 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.786204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eb63-ff40-4f4d-a881-41520226e077 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.786743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eb63-ff40-4f4d-a881-41520226e077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.819468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-8988eb63-ff40-4f4d-a881-41520226e077 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:36.821178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-8988eb63-ff40-4f4d-a881-41520226e077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:36.859274 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f8b1-7b75-42b7-bf66-e08fc9324145 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:36.905212 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:36.906074 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.906369 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.906653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.920836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:36.923740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 86/184] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:36.925333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3f033-53b8-4451-9d63-1dc0799ddc14 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.925921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3f033-53b8-4451-9d63-1dc0799ddc14 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.926431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3f033-53b8-4451-9d63-1dc0799ddc14 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:36.930655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:36.931707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:36.932626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:36.933327 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 87/185] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:36.933412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 99/186] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:36.937526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:36.937750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:36.938004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:36.938394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:36.962271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:36.964159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:36.974435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:36.990225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.063381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 88/187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:37.064244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.071286 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dd677-6f5c-4090-bf08-157eaf9e6585 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.114582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.115374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.115667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.115953 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.116719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:37.117037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.118444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.131051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 100/188] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:37.131051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.181934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc346-43bd-449c-b837-2240e715a003 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.216819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.217491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.220264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.220264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.220264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.232020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:37.234594 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865bfe-7c3b-44b6-b222-358e9e2beee0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:37.239808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:37.241025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 89/189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:37.241948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.257050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.274606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bee8c9-45fe-488a-a3f6-924e10df1ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.277584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bee8c9-45fe-488a-a3f6-924e10df1ef9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.277891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bee8c9-45fe-488a-a3f6-924e10df1ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.278182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bee8c9-45fe-488a-a3f6-924e10df1ef9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.288590 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bee8c9-45fe-488a-a3f6-924e10df1ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-41bee8c9-45fe-488a-a3f6-924e10df1ef9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:37.296864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:37.298035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:37.299045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 101/190] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:37.299847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24e7f-6ac1-4a66-90a1-7fefab019a99 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.299847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24e7f-6ac1-4a66-90a1-7fefab019a99 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.300021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24e7f-6ac1-4a66-90a1-7fefab019a99 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.301166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 102/191] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:37.303574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24e7f-6ac1-4a66-90a1-7fefab019a99 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.349500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627207-63bb-44dc-b03c-588d21602a1c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.383016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.383902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.384193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.384479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] PATH_INFO: `/v3/users/5dad019785a44d88907fd541693a7045` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.398054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] RBAC: Authorizing `identity:get_user(user_id=5dad019785a44d88907fd541693a7045)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.399558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.405648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 90/192] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/users/5dad019785a44d88907fd541693a7045 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:37.405648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.409709 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24e7f-6ac1-4a66-90a1-7fefab019a99 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.443642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.444247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.444543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.444820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.445577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:37.445887 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.447900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf132-babd-40df-abd0-520c0c10df95 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.456318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 103/193] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:37.457580 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.457879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.458166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.468816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.473030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.475482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:37.476721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:37.504709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b9e0-32b2-46df-b9e0-1b3323569c1f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.538864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.539543 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.539836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.540123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.541518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:37.541734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.543155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.543338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 104/194] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:37.547573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.555911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 91/195] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:37.555911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.654973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64332188-1f82-4f61-bccc-1c0e0906b579 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.660772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9c2c-26e4-4bdc-a111-8dfbacd51ed8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.690681 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.691539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.692207 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.692497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.692788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.696326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.696449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.697219 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.697664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.698110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] PATH_INFO: `/v3/users/91920df9ecb44e078b6b7858531f778c` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.699657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] RBAC: Authorizing `identity:get_user(user_id=91920df9ecb44e078b6b7858531f778c)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.701122 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.702805 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 92/196] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/users/91920df9ecb44e078b6b7858531f778c => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:37.702805 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.761122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.762603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.804791 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32041-6d6f-4e0e-819f-279f7e1e2088 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.838611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.839507 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.839795 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.840073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] PATH_INFO: `/v3/users/5dad019785a44d88907fd541693a7045` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.841546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] RBAC: Authorizing `identity:get_user(user_id=5dad019785a44d88907fd541693a7045)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.843017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.844648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 93/197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/users/5dad019785a44d88907fd541693a7045 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:37.845411 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.866545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 105/198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:37.867532 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:37.902858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.913934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:37.949367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9b7a-562c-4d0c-b70b-ba73963cda64 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.969604 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67ae7-515a-4d1a-8df3-3bbde63e112b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:37.984001 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:37.984804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:37.985090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:37.985372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:37.986559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:37.988065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:37.989738 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 94/199] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:37.990509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.010453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.011428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.011717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.011998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.082363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.084121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.097630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c021b-7a24-492d-b3c9-368f990ed05c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.117558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:38.131642 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.132309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.132598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.132883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.136418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:38.183382 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 106/200] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:38.184440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.204676 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.206079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.283995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552301-547d-4694-bd39-ddd76c05ba91 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.304090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 95/201] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:38.304913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.317711 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.318577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.318901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.319182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.320363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.321823 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.324158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 107/202] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:38 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:38.324914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.329004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:38.343672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:38.408337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac83f-4902-49a4-bcaa-b06a60421328 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.423509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c534e-5ee7-4688-9c15-5de6438735e0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.441862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.442538 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.442849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.443545 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.445724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.457071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.457891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.458154 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.458433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.459745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.461222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.463524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 108/203] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:38 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:38.466946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.467054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 96/204] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:38 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:38.467054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.549317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:38.573877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:38.583706 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f79e4d-f0b2-4f95-a586-71167a038a58 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.586070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925324-25d4-4926-b182-2f3513e31808 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.621542 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.622440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.622744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.623079 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.624368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.625882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.627530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.627709 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 109/205] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:38 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:38.628519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.628794 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.629259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.629545 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.630588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=5dad019785a44d88907fd541693a7045) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:38.630935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.632552 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.643164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 97/206] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:38 2022] GET /identity/v3/role_assignments?user.id=5dad019785a44d88907fd541693a7045&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:38.644267 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:38.774373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee9159-6e7f-4e13-9a6f-27be402a69f6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.793752 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0903d-641a-4232-aebd-7fa264d76bdb None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:38.821481 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.822674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.823162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.823606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.824658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] RBAC: Adding query filter params (role.id=99e96b0a95f54e22931046dc4da12b0a, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba, user.id=91920df9ecb44e078b6b7858531f778c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:38.825171 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.826866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bce54-146b-440d-ba92-4eb5084caa18 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.834826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 110/207] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:38 2022] GET /identity/v3/role_assignments?user.id=91920df9ecb44e078b6b7858531f778c&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=99e96b0a95f54e22931046dc4da12b0a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:38.850492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:38.851292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:38.851581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:38.851865 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:38.852749 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] RBAC: Adding query filter params (role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=5dad019785a44d88907fd541693a7045) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:38.853072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:38.855205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45dce4-3309-46b7-9a4b-946a17371386 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:38.863959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 98/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:38 2022] GET /identity/v3/role_assignments?user.id=5dad019785a44d88907fd541693a7045&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:40.955834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09965-28ae-4990-8353-11eb2f355651 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:40.956409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09965-28ae-4990-8353-11eb2f355651 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:40.956409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09965-28ae-4990-8353-11eb2f355651 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:40.958017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 111/209] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:40.963910 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:40.964387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:40.964755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:40.982274 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:40.983526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:41.006191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.012340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb1b9c-3f3b-4302-b109-9d4ad3021ed5 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.012718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb1b9c-3f3b-4302-b109-9d4ad3021ed5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.012918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb1b9c-3f3b-4302-b109-9d4ad3021ed5 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.020841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 112/210] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:41.024682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.025515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.026039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.033981 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.047444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:41.049158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:41.071331 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 99/211] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:41.099023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.136655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 113/212] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:41.167178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.211240 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003280f-7ab5-45fd-8493-ea49462b5e61 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.252992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcd71d-e417-4019-875b-3c5bdda0971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.253803 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd71d-e417-4019-875b-3c5bdda0971a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.254093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd71d-e417-4019-875b-3c5bdda0971a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.254378 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd71d-e417-4019-875b-3c5bdda0971a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.264656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcd71d-e417-4019-875b-3c5bdda0971a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bbbcd71d-e417-4019-875b-3c5bdda0971a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:41.272407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:41.273647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 100/213] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:41.274888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744eaa5-e1f7-4be4-82af-68a390771743 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.275934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744eaa5-e1f7-4be4-82af-68a390771743 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.275934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744eaa5-e1f7-4be4-82af-68a390771743 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.276919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 101/214] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:41.278450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f0a8-4dbc-423a-9dfa-5bfbb5a7dc48 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.280031 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603347f-49ba-40bb-b89c-ff1bc6a1c3a2 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.280323 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603347f-49ba-40bb-b89c-ff1bc6a1c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.280608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603347f-49ba-40bb-b89c-ff1bc6a1c3a2 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.281895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 102/215] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:41.282595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603347f-49ba-40bb-b89c-ff1bc6a1c3a2 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.295630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.317110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4474f-9834-487b-a6af-411b69258bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.317921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4474f-9834-487b-a6af-411b69258bf4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.318210 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4474f-9834-487b-a6af-411b69258bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.318490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4474f-9834-487b-a6af-411b69258bf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.320409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.330599 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4474f-9834-487b-a6af-411b69258bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-fcd4474f-9834-487b-a6af-411b69258bf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:41.338435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:41.339477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 114/216] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:41.345553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed470e0-5860-42ca-8cb4-2783c8fff5f6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.346367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed470e0-5860-42ca-8cb4-2783c8fff5f6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.346367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed470e0-5860-42ca-8cb4-2783c8fff5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.358447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-9ed470e0-5860-42ca-8cb4-2783c8fff5f6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:41.359667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-9ed470e0-5860-42ca-8cb4-2783c8fff5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:41.390360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603347f-49ba-40bb-b89c-ff1bc6a1c3a2 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.424505 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.425186 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.425425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 115/217] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:41.425581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.425758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.426516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:41.426859 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:41.427032 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.427298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.427582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.428263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:41.442356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 103/218] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:41.442356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.449170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:41.450384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:41.510930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.518848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 116/219] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:41.523716 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.541468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb4fff-01ca-4baa-afe5-e6f9aab8fa43 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.577091 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.577936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.578234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.578527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.579053 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.579328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] RBAC: Adding query filter params (name=member) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:41.579656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:41.581195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:41.590553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 104/220] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:41.591644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.627335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea6a3e-0039-4344-8b95-356c332826ee None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.661754 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.662642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.662974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.663261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] PATH_INFO: `/v3/users/5dad019785a44d88907fd541693a7045` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.664479 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] RBAC: Authorizing `identity:get_user(user_id=5dad019785a44d88907fd541693a7045)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:41.666589 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:41.668295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 117/221] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/users/5dad019785a44d88907fd541693a7045 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:41.669068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.699583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb7701-4a2f-4553-a270-319c7d23cf44 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.733284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.734077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.734364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.734643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.735861 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:41.737303 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:41.738955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 105/222] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:41.739712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.743010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.770679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2957606-315a-47c4-90f2-103561dc0028 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.793546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.806148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.807527 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.807814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.808093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.818200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:41.827338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:41.828555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 118/223] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:41.829661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.843611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd124-e0ae-4e11-9da3-abd70b34173c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.877356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.878230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.878523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.878827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] PATH_INFO: `/v3/users/b46617e16e564fee8f406bb5d5b7eda0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.892324 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] RBAC: Authorizing `identity:get_user(user_id=b46617e16e564fee8f406bb5d5b7eda0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:41.893806 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:41.895506 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 106/224] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/users/b46617e16e564fee8f406bb5d5b7eda0 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:41.896252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.935175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbbea1-7713-4e29-a57d-78e5781b4024 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:41.954998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:41.969462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:41.970332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:41.970620 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:41.970939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:41.972155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:41.973634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:41.975394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 119/225] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:41.976168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:41.998976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac18b5-a325-46f6-bc35-c98a57f5307e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.028395 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.034255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.034980 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.035269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.035549 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.036273 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.037725 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.070820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 107/226] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:41 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:42.070820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.088414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da9edb-51ff-4dae-89f3-e6e53f6c6e0d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.127982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.128687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.128981 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.129266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.130047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:42.130376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.131844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.146838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 120/227] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:42.146838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.181912 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6854b-ad23-4efb-bfb1-842bf3d834af None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.200062 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.224891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.225700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.226012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.226269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.268094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612c84f-d235-4e8d-a0f2-b76cf548b87a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.286300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.307952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.309447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.312027 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.312979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.313273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.313563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/5dad019785a44d88907fd541693a7045/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.315618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] RBAC: Authorizing `identity:create_grant(project_id=1093e61168974b61afd4a0751faf9a2f, user_id=5dad019785a44d88907fd541693a7045, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.317082 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.335273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 121/228] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:42 2022] PUT /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/5dad019785a44d88907fd541693a7045/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:42.336179 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.436207 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 108/229] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:42.442165 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.465212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.471316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f363-86a6-4631-913e-0b14630b2740 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.516969 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.518438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.518782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.519187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] PATH_INFO: `/v3/users/5dad019785a44d88907fd541693a7045` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.521198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] RBAC: Authorizing `identity:get_user(user_id=5dad019785a44d88907fd541693a7045)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.523144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.526368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 122/230] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:42 2022] GET /identity/v3/users/5dad019785a44d88907fd541693a7045 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:42.532159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.581189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.584087 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806b8f-3cb1-41be-bcdd-9e3bbd6d2cc6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.631401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.632287 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.632577 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.633028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.635385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.637189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.642885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 109/231] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:42 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:42.646596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.667803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c21c-97be-4584-891f-5156cbad21e4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.716598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.718392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.718859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.719292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.720690 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.723198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.725957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 123/232] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:42 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:42.731660 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.761152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.792812 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afcdf-047d-4fb6-9c40-88d24e5a32e7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.854599 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.855641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.856160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.856719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.857858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=b46617e16e564fee8f406bb5d5b7eda0) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:42.858381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.860278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d5ac-4b45-454a-a82d-c20fee9ee576 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:42.866819 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 110/233] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:42 2022] GET /identity/v3/role_assignments?user.id=b46617e16e564fee8f406bb5d5b7eda0&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:42.913186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa598bc-0d04-44e6-b1fe-0e4a5b52b2ce None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:42.926019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:42.967510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a814c4e-a257-4df4-b7f1-4a77d1c6b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:42.968801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814c4e-a257-4df4-b7f1-4a77d1c6b9d7 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.969331 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814c4e-a257-4df4-b7f1-4a77d1c6b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.969843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814c4e-a257-4df4-b7f1-4a77d1c6b9d7 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/5dad019785a44d88907fd541693a7045/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.979795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a814c4e-a257-4df4-b7f1-4a77d1c6b9d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1093e61168974b61afd4a0751faf9a2f, user_id=5dad019785a44d88907fd541693a7045, role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:42.981688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a814c4e-a257-4df4-b7f1-4a77d1c6b9d7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:43.022812 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 124/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:42 2022] PUT /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/5dad019785a44d88907fd541693a7045/roles/b7343e07f3324924a8676c7aad3628d0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:50:44.887427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511995e-45bd-4333-a5c5-e9d3b2ff94d9 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:44.887969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511995e-45bd-4333-a5c5-e9d3b2ff94d9 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:44.887969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511995e-45bd-4333-a5c5-e9d3b2ff94d9 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:44.889699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 111/235] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:44.895561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:44.896073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:44.896185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:44.915368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:44.917190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:44.935346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8f87-a529-4c7f-8647-e8ba6f389c3c None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:44.935671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8f87-a529-4c7f-8647-e8ba6f389c3c None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:44.935917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8f87-a529-4c7f-8647-e8ba6f389c3c None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:44.937608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 112/236] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:44.942672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1af4b-35aa-4251-bb06-4f5a21cd2eeb None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:44.943015 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1af4b-35aa-4251-bb06-4f5a21cd2eeb None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:44.943266 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1af4b-35aa-4251-bb06-4f5a21cd2eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:44.976628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-64f1af4b-35aa-4251-bb06-4f5a21cd2eeb None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:44.977835 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-64f1af4b-35aa-4251-bb06-4f5a21cd2eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:45.043211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 125/237] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:45.101740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 113/238] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:45.108142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.152687 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6e03-197a-4f31-a971-4e6bbf8fcdb5 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.152875 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6e03-197a-4f31-a971-4e6bbf8fcdb5 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.153160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6e03-197a-4f31-a971-4e6bbf8fcdb5 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.154553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 114/239] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:45.165582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.165886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.166150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.187796 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:45.189307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:45.227338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd216ba-031f-41da-9af9-31a4ccaba8f3 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.243163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:45.265063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.266330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.266870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.267360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.279238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:45.290811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 115/240] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:45.290811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.293246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:45.314343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:45.315743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:45.316671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:45.324429 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 126/241] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:45.325634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.407212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2212d0b-8859-4f8a-919a-55e34e72d59c None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.456041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.456870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.457141 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.457424 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.458492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c1fc-ee4f-4c51-a82d-6dc32515e2c2 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.458624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.460076 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.463253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 116/242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:45.468196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.501289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.502376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.503053 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.503641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.504769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:45.505329 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.507281 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.518780 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 127/243] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:45.519700 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.551840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:45.565440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:45.592176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c5480-be04-45ce-a54a-d9963524523f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.632161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.633409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.633928 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.634459 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.647068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:45.656205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:45.657308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:45.658288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:45.659024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3968083-4b17-4705-a832-303bc9ab02b0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.666393 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 117/244] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:45.667674 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.701872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.702576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.702902 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.703505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.704500 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.705990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.742825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 128/245] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:45 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:45.742825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.792794 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa580f-15e2-440d-b180-7aded2bd7fb4 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.836056 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293fee0-6c41-4186-ae99-5bdfc9a69b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.837075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293fee0-6c41-4186-ae99-5bdfc9a69b3c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.837480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293fee0-6c41-4186-ae99-5bdfc9a69b3c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.837835 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293fee0-6c41-4186-ae99-5bdfc9a69b3c None admin] PATH_INFO: `/v3/users/56a92add879d4c1985738ca0e2aa636d` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.843550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:45.852831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:45.858896 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293fee0-6c41-4186-ae99-5bdfc9a69b3c None admin] RBAC: Authorizing `identity:get_user(user_id=56a92add879d4c1985738ca0e2aa636d)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.860642 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293fee0-6c41-4186-ae99-5bdfc9a69b3c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.863111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 118/246] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/users/56a92add879d4c1985738ca0e2aa636d => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:45.864763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4528-8d49-4f3d-8bed-c800e6428a90 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.865130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4528-8d49-4f3d-8bed-c800e6428a90 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.865530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4528-8d49-4f3d-8bed-c800e6428a90 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.867672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 119/247] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:45.868719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4528-8d49-4f3d-8bed-c800e6428a90 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.899013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2391f25-2923-475e-92f9-23a24366afcc None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.952128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.952452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.954920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.954920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.954920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:45.954920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.961214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d469cc-3723-4609-b28d-6fc7f45111ed None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.970284 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 129/248] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:45.971628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.971908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.972190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.990632 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:45.991963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:46.001214 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4528-8d49-4f3d-8bed-c800e6428a90 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.048565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80f01-25a9-4084-bc1f-62fb2b0532dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.050281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80f01-25a9-4084-bc1f-62fb2b0532dd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.050743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80f01-25a9-4084-bc1f-62fb2b0532dd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.051070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80f01-25a9-4084-bc1f-62fb2b0532dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.078177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 130/249] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:46.079685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.136996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.146294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80f01-25a9-4084-bc1f-62fb2b0532dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:46.147918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80f01-25a9-4084-bc1f-62fb2b0532dd None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:46.172867 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.222207 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aacbd-9069-4602-ab23-d3ea8002abe6 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.264014 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 120/250] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:46.265388 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f85b-a726-4a20-bf40-65670fb68617 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.265688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f85b-a726-4a20-bf40-65670fb68617 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.265977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f85b-a726-4a20-bf40-65670fb68617 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.267335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 121/251] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:46.268044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f85b-a726-4a20-bf40-65670fb68617 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.275366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da475-4b45-4013-9e78-7b8bfc685660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.276602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da475-4b45-4013-9e78-7b8bfc685660 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.277886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da475-4b45-4013-9e78-7b8bfc685660 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.278180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da475-4b45-4013-9e78-7b8bfc685660 None admin] PATH_INFO: `/v3/users/5dad019785a44d88907fd541693a7045` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.279470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4da475-4b45-4013-9e78-7b8bfc685660 None admin] RBAC: Authorizing `identity:get_user(user_id=5dad019785a44d88907fd541693a7045)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:46.280964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4da475-4b45-4013-9e78-7b8bfc685660 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:46.286935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 131/252] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/users/5dad019785a44d88907fd541693a7045 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:46.288231 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.288528 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.288814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.308576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:46.309783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:46.389797 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 132/253] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:46.391141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.398181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.407736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f85b-a726-4a20-bf40-65670fb68617 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.445563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.446443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.446773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.447699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.459998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:46.468489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:46.469533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:46.470895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 122/254] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:46.475112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.499253 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.528923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6584d-ac2e-44eb-a167-5b14dcb499ed None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.567385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.568271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.568562 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.568837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.570063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:46.571638 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:46.573563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 133/255] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:46.574359 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.599111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52c90d-2ab3-4dec-82d7-fb25b070e856 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.648279 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.649253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.649547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.649880 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.684967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.685662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c0aa1-e85b-46ef-aef4-b28da0956eb0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.727404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.729572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.729944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.730448 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.733548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.743479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:46.745827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:46.746273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:46.757178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:46.758282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:46.759781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 134/256] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:46.760846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.875941 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 123/257] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:46.877291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:46.897701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3868-fb72-43e1-9a6a-e153ba0471c8 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:46.944451 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:46.945486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:46.945852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:46.946210 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:46.946691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:46.948020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:46.948338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:46.950556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:46.963659 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 135/258] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:46.964504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.020972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99be38-a5ca-43ec-be7b-d0054b641cfc None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.043132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.061678 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.062361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.062658 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.062988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.064799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] RBAC: Adding query filter params (role.id=99e96b0a95f54e22931046dc4da12b0a, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=56a92add879d4c1985738ca0e2aa636d) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:47.065127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.066586 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.074055 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 124/259] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/role_assignments?user.id=56a92add879d4c1985738ca0e2aa636d&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=99e96b0a95f54e22931046dc4da12b0a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.075321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.108006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9110f-6f18-4534-8858-8dabbc660cd4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.182854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.183566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.183856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.184140 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.184929 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:47.185248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.189505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.209421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 136/260] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.210154 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.279691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bad54-83cd-4a32-a455-8f58bcb1c70c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.301410 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.320425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.321302 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.322237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.322526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.323799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.325360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.330945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 125/261] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.331794 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.352584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15a995-c91c-4c4c-8836-7bbb7f030541 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.381191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.420536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.421538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.421827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.422104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] PATH_INFO: `/v3/users/b46617e16e564fee8f406bb5d5b7eda0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.423445 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] RBAC: Authorizing `identity:get_user(user_id=b46617e16e564fee8f406bb5d5b7eda0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.424916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.426690 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 137/262] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/users/b46617e16e564fee8f406bb5d5b7eda0 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.432041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.464849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aeb65-623c-412a-9bf2-46de85e19d3b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.505780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.510808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.511329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.511820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] PATH_INFO: `/v3/users/5dad019785a44d88907fd541693a7045` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.513319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] RBAC: Authorizing `identity:get_user(user_id=5dad019785a44d88907fd541693a7045)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.515075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.517691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 126/263] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/users/5dad019785a44d88907fd541693a7045 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.520508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.601094 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.601280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8477-9690-4f8b-add8-61ce664ed810 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.638719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.639448 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.639737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.640017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.640863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=5dad019785a44d88907fd541693a7045) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:47.641184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.642769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.654954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 138/264] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/role_assignments?user.id=5dad019785a44d88907fd541693a7045&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.656092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.667278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab87f1-8f6a-4296-ad55-fa6c3941438d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.717441 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.718833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.719360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.719881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.723831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.725862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.729161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 127/265] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.734597 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.737488 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.793822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6ff7-82c3-4e97-a92f-db54c6df1f1a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.831599 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.832509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.832701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.832938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.906634 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35ac7a-4097-4427-a549-e4299a54fd46 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:47.911652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.913188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:47.943064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.966098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:47.967583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.968156 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.968674 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/b46617e16e564fee8f406bb5d5b7eda0/roles/8fed1fbe1c3540dfa086071e3ef21c4e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.970108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:47.978781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1093e61168974b61afd4a0751faf9a2f, user_id=b46617e16e564fee8f406bb5d5b7eda0, role_id=8fed1fbe1c3540dfa086071e3ef21c4e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:47.980623 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.020294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 128/266] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:47 2022] PUT /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/b46617e16e564fee8f406bb5d5b7eda0/roles/8fed1fbe1c3540dfa086071e3ef21c4e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:48.026656 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 139/267] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:48.032554 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.185990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b32a0-3398-423c-bd49-233fe6236ad3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.238471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afbc12-d212-46c1-894d-8499bf5ed818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.239852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afbc12-d212-46c1-894d-8499bf5ed818 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.240379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afbc12-d212-46c1-894d-8499bf5ed818 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.240881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afbc12-d212-46c1-894d-8499bf5ed818 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.247514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afbc12-d212-46c1-894d-8499bf5ed818 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.249329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afbc12-d212-46c1-894d-8499bf5ed818 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.251420 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 129/268] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:48.257539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.378894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65161b09-d300-4459-8e87-5812b7d8f22b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.425744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.426439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.426956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.427247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.428240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] RBAC: Adding query filter params (role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=5dad019785a44d88907fd541693a7045) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:48.428563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.430344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365872d-9f1c-4717-bd9b-d8f1b376cc73 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.440026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 140/269] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/role_assignments?user.id=5dad019785a44d88907fd541693a7045&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:48.612858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad06994-0d04-46b5-9476-5e005d8f01b4 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.613257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad06994-0d04-46b5-9476-5e005d8f01b4 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.613446 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad06994-0d04-46b5-9476-5e005d8f01b4 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.615244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 130/270] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:48.622158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d027af-8172-4900-848d-afece1601e70 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.623018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d027af-8172-4900-848d-afece1601e70 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.623522 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d027af-8172-4900-848d-afece1601e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.647900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d4d027af-8172-4900-848d-afece1601e70 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:48.649561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d4d027af-8172-4900-848d-afece1601e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:48.666955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.745306 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 141/271] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:48.771829 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad06994-0d04-46b5-9476-5e005d8f01b4 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.832219 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.833219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170530-5b3d-4c39-b426-e506d43e9d71 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.833520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170530-5b3d-4c39-b426-e506d43e9d71 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.833812 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170530-5b3d-4c39-b426-e506d43e9d71 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.835272 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 142/272] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:48.842436 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.842732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.843059 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.864467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:48.865678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:48.896941 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad06994-0d04-46b5-9476-5e005d8f01b4 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.940664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.941687 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.941982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.942481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.956853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 143/273] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:48.963797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:48.972421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:48.973454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:48.974406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:48.979531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.982190 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 131/274] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:48.989192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:49.077341 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:49.107866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2d58-2daf-4625-88c1-e5657e78ff5e None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:49.123328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4916d-131a-4ef6-9a16-8bbd79953f46 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:49.136660 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:49.150316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:49.151407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.152032 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.152566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.155407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:49.155747 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:49.157187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:49.168651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:49.173908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 144/275] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:49.174053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.174053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.174053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.175819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:49.176620 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:49.178148 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:49.185769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 132/276] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:49.187278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:49.307550 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea747-ea23-4d36-8f24-f9907bdb045c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:49.315975 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca236ed-376a-4d33-8d35-9966fc24640c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:49.351092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:49.352523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.353386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.354171 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] PATH_INFO: `/v3/users/7bbcaf0c72b842faaa22ba5b292e9deb` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.357252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:49.358026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3051-2816-42b8-b20d-34cc42010e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:49.359339 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3051-2816-42b8-b20d-34cc42010e05 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.359700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3051-2816-42b8-b20d-34cc42010e05 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.360037 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3051-2816-42b8-b20d-34cc42010e05 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.360776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d3051-2816-42b8-b20d-34cc42010e05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:49.362177 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d3051-2816-42b8-b20d-34cc42010e05 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:49.377094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbcaf0c72b842faaa22ba5b292e9deb)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:49.379275 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:49.381887 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 145/277] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:49 2022] GET /identity/v3/users/7bbcaf0c72b842faaa22ba5b292e9deb => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:49.391019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 133/278] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:50:49 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:50:49.392323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:49.518986 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6da8d8-d549-4637-9f65-82658b08b268 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:49.558675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:49.559318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.559607 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.559888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.560751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, user.id=7bbcaf0c72b842faaa22ba5b292e9deb, scope.system=all) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:49.561071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:49.562572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62170b1f-9535-4031-acc7-6d3f0f62b394 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:49.568980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 146/279] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:50:49 2022] GET /identity/v3/role_assignments?user.id=7bbcaf0c72b842faaa22ba5b292e9deb&scope.system=all&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:49.929937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce80-3903-47b3-9ab6-c82d8587492d None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.930258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce80-3903-47b3-9ab6-c82d8587492d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.930522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce80-3903-47b3-9ab6-c82d8587492d None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.932839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 134/280] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:49.938437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:49.938737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:49.939071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:49.956830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:49.958045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:50.019593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:50.038904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 147/281] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:50.058893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce80-3903-47b3-9ab6-c82d8587492d None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:50.107612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:50.199038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce80-3903-47b3-9ab6-c82d8587492d None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:50.243875 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:50.244756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:50.245051 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:50.245337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:50.256115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:50.266440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:50.267491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:50.268428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:50.272585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 135/282] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:50.273987 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:50.390937 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aa358-4809-400f-be83-0f19af3bf914 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:50.425818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d563a-5735-460a-bd51-018488c43831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:50.426510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d563a-5735-460a-bd51-018488c43831 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:50.426820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d563a-5735-460a-bd51-018488c43831 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:50.427112 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d563a-5735-460a-bd51-018488c43831 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:50.427884 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d563a-5735-460a-bd51-018488c43831 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:50.428201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d563a-5735-460a-bd51-018488c43831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:50.429640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d563a-5735-460a-bd51-018488c43831 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:50.442906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 148/283] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:50.444496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:50.561632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:50.568592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777fba-a1e7-48f8-8791-56b239853193 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:50.612895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:50.613796 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:50.614091 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:50.614376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] PATH_INFO: `/v3/users/56a92add879d4c1985738ca0e2aa636d` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:50.615670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] RBAC: Authorizing `identity:get_user(user_id=56a92add879d4c1985738ca0e2aa636d)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:50.617140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:50.619570 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 136/284] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:50 2022] GET /identity/v3/users/56a92add879d4c1985738ca0e2aa636d => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:50.625356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d563a-5735-460a-bd51-018488c43831 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:50.712196 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:50.784898 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d563a-5735-460a-bd51-018488c43831 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:50.822697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beec95-6a22-4cd4-b101-c34cbafaaf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:50.823794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beec95-6a22-4cd4-b101-c34cbafaaf0b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:50.824083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beec95-6a22-4cd4-b101-c34cbafaaf0b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:50.824363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beec95-6a22-4cd4-b101-c34cbafaaf0b None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:50.825586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beec95-6a22-4cd4-b101-c34cbafaaf0b None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:50.827075 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beec95-6a22-4cd4-b101-c34cbafaaf0b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:50.829110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 149/285] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:50 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:50.836063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:50.977536 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da8b19-6aae-4fda-8719-a09e234158b6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:51.035592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402555-e786-4577-98e4-e56917543397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:51.036507 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402555-e786-4577-98e4-e56917543397 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.036801 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402555-e786-4577-98e4-e56917543397 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.037089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402555-e786-4577-98e4-e56917543397 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/56a92add879d4c1985738ca0e2aa636d/roles/99e96b0a95f54e22931046dc4da12b0a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.039181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402555-e786-4577-98e4-e56917543397 None admin] RBAC: Authorizing `identity:create_grant(project_id=1093e61168974b61afd4a0751faf9a2f, user_id=56a92add879d4c1985738ca0e2aa636d, role_id=99e96b0a95f54e22931046dc4da12b0a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:51.041263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402555-e786-4577-98e4-e56917543397 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:51.048392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dd0ba-0522-4e48-a8dd-5678ec8b2103 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.048871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dd0ba-0522-4e48-a8dd-5678ec8b2103 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.048978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dd0ba-0522-4e48-a8dd-5678ec8b2103 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.050348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 150/286] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:51.056755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.057051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.057340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.075063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 137/287] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:50:50 2022] PUT /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f/users/56a92add879d4c1985738ca0e2aa636d/roles/99e96b0a95f54e22931046dc4da12b0a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:51.088620 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:51.089879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:51.198958 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 151/288] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:51.218246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402555-e786-4577-98e4-e56917543397 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.253151 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:51.343421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402555-e786-4577-98e4-e56917543397 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:51.379989 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:51.380867 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.381161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.381483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.392752 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:51.401283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:51.402286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:51.403259 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:51.406878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 138/289] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:51.408769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.469295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:51.541313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4afee-b152-491e-bbaa-a5b99ef09264 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:51.590853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:51.591613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.591908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.592249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.593020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:51.593340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:51.594820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:51.607101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 152/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:51.612915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.708508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:51.737817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0562d42-8bd8-4f2c-8dc5-afe57335e99d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:51.792025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:51.792987 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.793278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.793564 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] PATH_INFO: `/v3/users/b46617e16e564fee8f406bb5d5b7eda0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.794911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] RBAC: Authorizing `identity:get_user(user_id=b46617e16e564fee8f406bb5d5b7eda0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:51.796417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:51.799432 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 139/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/users/b46617e16e564fee8f406bb5d5b7eda0 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:51.804058 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.912039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0edc-b2ab-4428-8b7c-b5e8d76d9c26 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:51.930372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:51.961130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc0669-d422-43fb-811c-fdd0e43de9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:51.961803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0669-d422-43fb-811c-fdd0e43de9fb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.962659 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0669-d422-43fb-811c-fdd0e43de9fb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.962992 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0669-d422-43fb-811c-fdd0e43de9fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.054759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0669-d422-43fb-811c-fdd0e43de9fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.056863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0669-d422-43fb-811c-fdd0e43de9fb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.167477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 153/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:52.175960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.327842 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c9b0-ec87-48f8-bf9f-32c28cd8db89 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.376290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec34097-7224-4067-b437-a3a95e89dd25 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.376688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.377227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec34097-7224-4067-b437-a3a95e89dd25 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.377573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.377868 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.378156 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.378417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec34097-7224-4067-b437-a3a95e89dd25 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.379416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.380422 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 154/293] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:52.386816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.386976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f7f3-eb10-4868-89b9-069398d4dbd1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.386976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f7f3-eb10-4868-89b9-069398d4dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.386976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f7f3-eb10-4868-89b9-069398d4dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.388166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 140/294] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:52.389319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.415532 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-a593f7f3-eb10-4868-89b9-069398d4dbd1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:52.416768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-a593f7f3-eb10-4868-89b9-069398d4dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:52.424391 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.427294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.504945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 155/295] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:52.506687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef6d8-6879-4989-9e63-f74f961ddcfe None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.507201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef6d8-6879-4989-9e63-f74f961ddcfe None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.507665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef6d8-6879-4989-9e63-f74f961ddcfe None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.513382 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 156/296] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:52.514837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa3e6-3873-4511-9216-e08089e1d979 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.515349 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa3e6-3873-4511-9216-e08089e1d979 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.515835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa3e6-3873-4511-9216-e08089e1d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.533425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-4eaaa3e6-3873-4511-9216-e08089e1d979 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:52.534756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-4eaaa3e6-3873-4511-9216-e08089e1d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:52.536398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226609d-4771-4b4b-b44d-0ef2feea960f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.588286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.589095 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.589391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.589679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.590894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=b46617e16e564fee8f406bb5d5b7eda0) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:52.591419 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.592882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.599102 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 141/297] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/role_assignments?user.id=b46617e16e564fee8f406bb5d5b7eda0&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:52.604041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.612833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 157/298] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:52.621078 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f65f8c-8b00-4bb4-8c64-1bfc15b1f507 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.621504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f65f8c-8b00-4bb4-8c64-1bfc15b1f507 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.621916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f65f8c-8b00-4bb4-8c64-1bfc15b1f507 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.636188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 158/299] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:52 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:52.638214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.638644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.639056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.662218 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:52.663904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:52.736595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.740833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.755627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 159/300] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:52.755968 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.780953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8d45c-953d-483b-a08e-39fa8bacf2f1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.828596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.830664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.831016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.831306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.849873 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:52.863375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:52.864510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 142/301] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:52.866082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.906028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf5a03-ca21-4d54-ad87-87da2e72168d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.950564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.951399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.951693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.951973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.953180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.954644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.956345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 160/302] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:52.957190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.987632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901722-ba8b-44b2-a478-f68072338f49 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.032053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.032946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.033313 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.033936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.034670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.045486 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:53.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:53.054440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 143/303] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:53.056447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.060634 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.077008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2bf18-bc49-473a-9b1b-0906ed152523 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.113924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.114608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.114941 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.115234 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.115986 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:53.116304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.117714 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.126566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 161/304] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:53.127418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.169496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0bb8-29bd-4d23-8b4f-68b4b0c9c6bf None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.206354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.207101 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.207396 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.207685 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] PATH_INFO: `/v3/groups` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.208915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.209909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.234334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 144/305] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:53.235535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.248586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300217-50da-40e8-8769-b62d665ccba1 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.296731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.297952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.298436 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.298930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.300679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:53.301196 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.303475 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.317610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.322118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 162/306] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:53.324007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.333531 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.387635 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918602e-bc35-446c-bcf1-93824d0a23b1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.427080 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.428148 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.428857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.428987 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] PATH_INFO: `/v3/users/7bbcaf0c72b842faaa22ba5b292e9deb` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.430361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbcaf0c72b842faaa22ba5b292e9deb)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.432519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.434573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 145/307] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:53 2022] GET /identity/v3/users/7bbcaf0c72b842faaa22ba5b292e9deb => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:53.439814 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.460790 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb546-79d8-4956-89a2-0acc9f82acf8 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.501511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.502323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.502618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.502966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] PATH_INFO: `/v3/users/c52fdd9bcc754fc0b3991af2f5ad75bf` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.518158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=c52fdd9bcc754fc0b3991af2f5ad75bf)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.519757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.521712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 163/308] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:53 2022] GET /identity/v3/users/c52fdd9bcc754fc0b3991af2f5ad75bf => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:53.527455 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.567126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7295b9-bfa5-4698-81ef-a6726ea2ce95 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.580703 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.600495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.609215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf76dad-4378-4e8c-b02d-3d9b9dfee0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.610565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76dad-4378-4e8c-b02d-3d9b9dfee0a9 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.611084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76dad-4378-4e8c-b02d-3d9b9dfee0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.611554 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76dad-4378-4e8c-b02d-3d9b9dfee0a9 None admin] PATH_INFO: `/v3/system/users/7bbcaf0c72b842faaa22ba5b292e9deb/roles/8fed1fbe1c3540dfa086071e3ef21c4e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.613580 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf76dad-4378-4e8c-b02d-3d9b9dfee0a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7bbcaf0c72b842faaa22ba5b292e9deb, role_id=8fed1fbe1c3540dfa086071e3ef21c4e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.615437 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf76dad-4378-4e8c-b02d-3d9b9dfee0a9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.635961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 146/309] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:50:53 2022] PUT /identity/v3/system/users/7bbcaf0c72b842faaa22ba5b292e9deb/roles/8fed1fbe1c3540dfa086071e3ef21c4e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:53.647738 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f037ac-859c-479a-abac-9a866fa72bd9 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.690265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.691016 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.691357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.691739 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.692600 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] RBAC: Adding query filter params (role.id=99e96b0a95f54e22931046dc4da12b0a, user.id=c52fdd9bcc754fc0b3991af2f5ad75bf, scope.system=all) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:53.692974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.694590 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7e470-228c-46e2-bb1b-c8b7610898b4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.702080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 164/310] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:50:53 2022] GET /identity/v3/role_assignments?user.id=c52fdd9bcc754fc0b3991af2f5ad75bf&scope.system=all&role.id=99e96b0a95f54e22931046dc4da12b0a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:54.045497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb1f60-2513-4a59-8733-2c80b6c89a09 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:54.045797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb1f60-2513-4a59-8733-2c80b6c89a09 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:54.046092 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb1f60-2513-4a59-8733-2c80b6c89a09 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:54.047839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 147/311] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:54.053222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:54.053520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:54.053812 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:54.071724 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:54.072967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:54.143555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 165/312] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:54.167836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb1f60-2513-4a59-8733-2c80b6c89a09 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:54.278851 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb1f60-2513-4a59-8733-2c80b6c89a09 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:54.313408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:54.314270 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:54.314570 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:54.314883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:54.326248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:54.334418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:54.335882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:54.336811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:54.340854 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 148/313] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:54.342207 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:54.392438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:54.450198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766090e-dbf1-4c8f-b03c-efc521812e5f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:54.489074 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:54.489822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:54.490109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:54.490387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:54.491237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:54.491548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:54.492947 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:54.502919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 166/314] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:54.512017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:54.584453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:54.633226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5400389-5bc3-4a22-b853-f6f2571c78c7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:54.676875 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:54.677764 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:54.678052 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:54.678335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] PATH_INFO: `/v3/users/56a92add879d4c1985738ca0e2aa636d` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:54.679580 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] RBAC: Authorizing `identity:get_user(user_id=56a92add879d4c1985738ca0e2aa636d)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:54.681568 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:54.683561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 149/315] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:54 2022] GET /identity/v3/users/56a92add879d4c1985738ca0e2aa636d => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:54.688919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:54.794009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ac943-ef0d-4787-a2a1-5d8e4fe259fb None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:54.800929 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:54.829641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:54.830306 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:54.830597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:54.830906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:54.913287 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:54.914677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:55.017291 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 167/316] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:50:55.023572 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:55.135826 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dfd75-9c19-4df1-943a-653d91bb7b5b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:55.159826 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:55.179505 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d039-24b0-4cdf-8c3e-3f07f79970a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:55.180327 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d039-24b0-4cdf-8c3e-3f07f79970a0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.180626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d039-24b0-4cdf-8c3e-3f07f79970a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.180913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d039-24b0-4cdf-8c3e-3f07f79970a0 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.182170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d039-24b0-4cdf-8c3e-3f07f79970a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:55.184164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d039-24b0-4cdf-8c3e-3f07f79970a0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:55.186252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 150/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:50:55 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:55.195773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:55.206836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:55.306642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595422-069f-4638-81e1-bddea98945bd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:55.343031 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:55.344116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.344614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.345103 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.346146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] RBAC: Adding query filter params (role.id=99e96b0a95f54e22931046dc4da12b0a, scope.project.id=1093e61168974b61afd4a0751faf9a2f, user.id=56a92add879d4c1985738ca0e2aa636d) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:55.346672 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:55.348381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4125e-b614-45f8-ae26-c8730eaa7819 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:55.355569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 168/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:50:55 2022] GET /identity/v3/role_assignments?user.id=56a92add879d4c1985738ca0e2aa636d&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=99e96b0a95f54e22931046dc4da12b0a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:55.679431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1622d-ef8d-4c7e-9e68-dbae485773b8 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.679967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1622d-ef8d-4c7e-9e68-dbae485773b8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.680054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1622d-ef8d-4c7e-9e68-dbae485773b8 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.681449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 151/319] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:55.687269 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.687564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.687842 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.705067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:55.706250 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:55.774390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:55.783159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 169/320] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:55.802359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1622d-ef8d-4c7e-9e68-dbae485773b8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:55.915952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1622d-ef8d-4c7e-9e68-dbae485773b8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:55.950183 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a02a-aa76-48a1-9132-1b3acd8681e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:55.951012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a02a-aa76-48a1-9132-1b3acd8681e6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.951299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a02a-aa76-48a1-9132-1b3acd8681e6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.951579 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a02a-aa76-48a1-9132-1b3acd8681e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.952741 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a02a-aa76-48a1-9132-1b3acd8681e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:55.954200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a02a-aa76-48a1-9132-1b3acd8681e6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:55.956026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 152/321] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:55.961414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.028172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e904-9188-44ed-afdb-e7cc8127d3d8 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.028479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e904-9188-44ed-afdb-e7cc8127d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.028766 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7e904-9188-44ed-afdb-e7cc8127d3d8 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.030291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 153/322] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:56.035058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86838-6979-4a9e-8d46-31ab925d6efa None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.035352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86838-6979-4a9e-8d46-31ab925d6efa None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.035639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86838-6979-4a9e-8d46-31ab925d6efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.052394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-28d86838-6979-4a9e-8d46-31ab925d6efa None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:56.053608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-28d86838-6979-4a9e-8d46-31ab925d6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:56.069294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0626be-f954-4f7f-90c8-0347c80d058e None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.103836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833e6f8-1b8c-48a7-871e-52f5afffcc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.104516 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833e6f8-1b8c-48a7-871e-52f5afffcc7d None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.104808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833e6f8-1b8c-48a7-871e-52f5afffcc7d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.105096 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833e6f8-1b8c-48a7-871e-52f5afffcc7d None admin] PATH_INFO: `/v3/groups` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.105803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833e6f8-1b8c-48a7-871e-52f5afffcc7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.107316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833e6f8-1b8c-48a7-871e-52f5afffcc7d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.126841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 170/323] 10.222.0.71 () {60 vars in 1134 bytes} [Thu May 19 14:50:55 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:56.126841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78633401-dbb7-48c1-aafa-37ecbb92fd64 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.126841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78633401-dbb7-48c1-aafa-37ecbb92fd64 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.126841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78633401-dbb7-48c1-aafa-37ecbb92fd64 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.127498 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 154/324] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:56.127581 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 171/325] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:56.131800 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.132181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.132471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.150603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78633401-dbb7-48c1-aafa-37ecbb92fd64 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.151936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:56.153177 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:56.220837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.250815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 155/326] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:56.265106 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.271540 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78633401-dbb7-48c1-aafa-37ecbb92fd64 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.310053 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.310939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.311731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.311731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.324532 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:56.332420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:56.333505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:56.334434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 172/327] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:56.339463 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.385416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adec71-8f5d-4267-9c4a-e317f508ba59 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.408523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.433520 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.434337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.434627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.434945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.448799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:56.456952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:56.457997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:56.459012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 156/328] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:56.464975 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.475033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cf8f8-57bc-448e-9feb-946871347fa3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.503071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.526130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.526879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.527174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.527457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.528665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:56.528665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.529953 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.542658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 173/329] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.549991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.599395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46200ce3-7d06-4f23-8d8f-da5eafae363c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.644911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.646154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.646605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.647115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.647897 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:56.648376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.650864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.663719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 157/330] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.669969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.695261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8b00-1030-4346-afa5-5bb8f2b7dde7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.719070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.742198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.751656 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.753320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.754094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] PATH_INFO: `/v3/users/7bbcaf0c72b842faaa22ba5b292e9deb` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.755260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] RBAC: Authorizing `identity:get_user(user_id=7bbcaf0c72b842faaa22ba5b292e9deb)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.756840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.763172 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 174/331] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/users/7bbcaf0c72b842faaa22ba5b292e9deb => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.765360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.796234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0435c-eec3-4f4c-9a5f-c0a1843e65c6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.832761 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.844008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.844008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.845851 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.846162 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] PATH_INFO: `/v3/users/c52fdd9bcc754fc0b3991af2f5ad75bf` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.847517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] RBAC: Authorizing `identity:get_user(user_id=c52fdd9bcc754fc0b3991af2f5ad75bf)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.848973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.850827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 158/332] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/users/c52fdd9bcc754fc0b3991af2f5ad75bf => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.856642 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.900297 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70bae2-f4b6-48ca-9554-00d408ed8135 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.949547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.950588 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.951137 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.951623 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.952707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] RBAC: Adding query filter params (role.id=8fed1fbe1c3540dfa086071e3ef21c4e, user.id=7bbcaf0c72b842faaa22ba5b292e9deb, scope.system=all) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:56.953260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.955024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3a51b-1050-4de9-8243-c74b7934786e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.968164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 175/333] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/role_assignments?user.id=7bbcaf0c72b842faaa22ba5b292e9deb&scope.system=all&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:57.006897 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64dc9f-31be-45e7-ac89-2864857d5ddc None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:57.020012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:57.053635 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c1961-a452-4779-8019-e7f360ed500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:57.054962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1961-a452-4779-8019-e7f360ed500f None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:57.055461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1961-a452-4779-8019-e7f360ed500f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:57.056563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1961-a452-4779-8019-e7f360ed500f None admin] PATH_INFO: `/v3/system/users/c52fdd9bcc754fc0b3991af2f5ad75bf/roles/99e96b0a95f54e22931046dc4da12b0a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:57.058558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1961-a452-4779-8019-e7f360ed500f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c52fdd9bcc754fc0b3991af2f5ad75bf, role_id=99e96b0a95f54e22931046dc4da12b0a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:57.060407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1961-a452-4779-8019-e7f360ed500f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:57.074431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 159/334] 10.222.0.71 () {58 vars in 1334 bytes} [Thu May 19 14:50:56 2022] PUT /identity/v3/system/users/c52fdd9bcc754fc0b3991af2f5ad75bf/roles/99e96b0a95f54e22931046dc4da12b0a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:50:58.943147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468985-1f1c-417a-9b50-a12b400066de None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:58.944267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468985-1f1c-417a-9b50-a12b400066de None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:58.944777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468985-1f1c-417a-9b50-a12b400066de None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:58.946931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 176/335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:58.952763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:58.953270 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:58.953362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:58.979913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:58.981164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:58.995469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792202-4284-4025-bc03-1ebc4f2ee8cf None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:58.995805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792202-4284-4025-bc03-1ebc4f2ee8cf None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:58.996049 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792202-4284-4025-bc03-1ebc4f2ee8cf None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:58.997719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 177/336] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:59.019407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.019706 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.019991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.064409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:59.065171 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:59.097146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 160/337] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:59.145166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.173082 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 178/338] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:59.211190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.295190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:59.330193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf31631-dd51-4fb9-ab19-2751b591d07f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:59.331857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:59.414573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:59.415796 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.416437 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.417976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.428690 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dcb20-77cb-42a4-b230-3170a9538faa None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:59.443408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:59.454409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:59.455786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:50:59.457050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 161/339] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:50:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:59.469739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.515559 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:59.516693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.517160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.517606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.547726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:59.562825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:59.564122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:50:59.565240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:50:59.567575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 179/340] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:59.579000 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.681586 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10403848-acb3-4f93-a56a-9237822eaf5d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:59.755420 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:59.756475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.756775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.757064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.758012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:59.758334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:59.760494 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:59.778673 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 162/341] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:50:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:59.789811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.837297 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:59.842260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:59.844730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470c0c-338f-4373-a7cf-639e4e04e400 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:59.939525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:59.940523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.940991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.941437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.942373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:59.942876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:59.944482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:59.958379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 180/342] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:59.963588 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.984779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6c82c-d811-4e7c-b574-2fcddf6f8f20 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:00.077026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5871fb9-2d74-4a7d-ab22-e10fc000f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:00.077705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5871fb9-2d74-4a7d-ab22-e10fc000f772 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.077992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5871fb9-2d74-4a7d-ab22-e10fc000f772 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.078274 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5871fb9-2d74-4a7d-ab22-e10fc000f772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.215809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0786cc4-5be8-4f3c-a11f-ecd13d75e00f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:00.280721 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5871fb9-2d74-4a7d-ab22-e10fc000f772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:00.282226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5871fb9-2d74-4a7d-ab22-e10fc000f772 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:00.304539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4488fa1-019c-4176-828f-156e180f6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:00.305225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488fa1-019c-4176-828f-156e180f6c04 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.306254 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488fa1-019c-4176-828f-156e180f6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.306553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4488fa1-019c-4176-828f-156e180f6c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.327225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:00.359573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:00.435996 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4488fa1-019c-4176-828f-156e180f6c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:00.437815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4488fa1-019c-4176-828f-156e180f6c04 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:00.486488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 163/343] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:00.488587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fc687-d892-4fe5-8306-c3918535fa86 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.489320 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fc687-d892-4fe5-8306-c3918535fa86 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.489821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fc687-d892-4fe5-8306-c3918535fa86 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.491386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 164/344] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:00.495077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fc687-d892-4fe5-8306-c3918535fa86 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:00.620586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 181/345] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:00.622301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acac60-5699-4966-9b9c-91bea58a9d1d None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.622866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acac60-5699-4966-9b9c-91bea58a9d1d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.623355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fc687-d892-4fe5-8306-c3918535fa86 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:00.623619 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acac60-5699-4966-9b9c-91bea58a9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.652924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-61acac60-5699-4966-9b9c-91bea58a9d1d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:00.654511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-61acac60-5699-4966-9b9c-91bea58a9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:00.658242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:00.669598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732004-48a7-407b-8178-4e44000554a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:00.670492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732004-48a7-407b-8178-4e44000554a8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.670783 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732004-48a7-407b-8178-4e44000554a8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.671107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732004-48a7-407b-8178-4e44000554a8 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.672354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab732004-48a7-407b-8178-4e44000554a8 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:00.673838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab732004-48a7-407b-8178-4e44000554a8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:00.675931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 165/346] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:00 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:00.677193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a13f7-31f4-4233-a883-5d6b12c73001 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.677485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a13f7-31f4-4233-a883-5d6b12c73001 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.677781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a13f7-31f4-4233-a883-5d6b12c73001 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.679676 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 166/347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:00.680487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a13f7-31f4-4233-a883-5d6b12c73001 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:00.739659 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:00.757859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 182/348] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:00.760183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ce03-b9f7-4ada-ac30-81797c892d91 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.760894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ce03-b9f7-4ada-ac30-81797c892d91 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.761206 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ce03-b9f7-4ada-ac30-81797c892d91 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.763189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 183/349] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:00.764551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.764842 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.767131 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.788376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:00.789560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:00.815090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a13f7-31f4-4233-a883-5d6b12c73001 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:00.864759 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894474d-d58a-4f90-b5f8-5d7c4295cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:00.866022 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894474d-d58a-4f90-b5f8-5d7c4295cebb None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.866451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894474d-d58a-4f90-b5f8-5d7c4295cebb None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.866951 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894474d-d58a-4f90-b5f8-5d7c4295cebb None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.869347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894474d-d58a-4f90-b5f8-5d7c4295cebb None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:00.870926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894474d-d58a-4f90-b5f8-5d7c4295cebb None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:00.871966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 184/350] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:00.872610 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 167/351] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:00 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:00.873313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:00.873806 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:00.874189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:00.874471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:00.903718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:00.905976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:00.979255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:00.999542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 168/352] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:01.000309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.036959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58566a-d5db-4ad8-b9aa-a121a6b7ccd1 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.067314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.095345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.096221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.096504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.096778 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.106214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:01.107886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:01.110561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 185/353] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:00 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:01.111995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.148543 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3b69e-9dae-4912-91ae-8a8f05bdab01 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.189676 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.190920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.191236 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.191583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.208266 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:01.218455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:01.219612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:01.220560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 169/354] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:01.223876 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.233276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c16c0-d996-4235-85e7-0a79f8561820 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.282850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.284636 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.285180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.286017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.287930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:01.290338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:01.293207 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 186/355] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:01.294351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.299016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.369533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.375079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9957c1-78d0-4913-8040-06a07fefc42a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.416163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.417390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.417691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.417972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.433041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c593f-118e-4498-910d-0ca596adb648 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.433401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:01.443242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:01.444263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:01.445211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 170/356] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:01.447101 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.478151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.478997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.479295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.479585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.491083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:01.499190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:01.500292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:01.501288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 187/357] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:01.502090 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.574132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f33d18-fae8-47f7-a8fa-4693700b850f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.586080 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.617740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.618469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.618765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.619123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.620023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:01.620349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:01.621824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:01.625804 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295edb1d-8563-4ae8-809d-da01a9c8231f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.628192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 171/358] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:01.628932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.642814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.681593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.682310 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.682606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.682936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.683733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:01.684058 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:01.685896 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:01.696144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 188/359] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:01.699807 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.772421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346898b-78a7-4cb0-8f9a-69a7bcf4d312 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.813798 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.814591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.814908 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.815313 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.816256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:01.816612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:01.818072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560a52-9998-4dc2-8176-f37406e3dd6a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:01.826342 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 172/360] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:01.827763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47125-a98d-413e-8ecf-ff3f1556d236 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.828065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47125-a98d-413e-8ecf-ff3f1556d236 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.828353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47125-a98d-413e-8ecf-ff3f1556d236 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.829651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 173/361] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:01.830377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47125-a98d-413e-8ecf-ff3f1556d236 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.841637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a1f20-0c8a-4e03-a96a-03baaae7e323 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:01.889429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.895408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:01.896124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:01.896417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:01.896707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:01.898911 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:01.899786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:01.901712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:01.915260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 189/362] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:01.915490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:01.963300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:01.989848 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47125-a98d-413e-8ecf-ff3f1556d236 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.048639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.050168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.050695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.051251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.052258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:02.052799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.054506 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460351-32ca-4a23-94f4-ca80c405cb49 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.065582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6105345-d3f9-4ec6-9262-81bb552bef77 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.066145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 174/363] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:02.068918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.068918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.068918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.092889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:02.094126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:02.105363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.106037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.106325 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.106712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.179006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 175/364] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:02.180003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.183675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.185182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.239269 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.240244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.322824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 190/365] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:02.322824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.353264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124b7d7-b80b-4245-ab11-485d39cd5281 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.401997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.403292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.404452 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.404967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.449733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86f3ef-24b6-4f7a-8dd9-140ed856e48a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.499650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.500780 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.500919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.501104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.501353 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] PATH_INFO: `/v3/users/c52fdd9bcc754fc0b3991af2f5ad75bf` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.502361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.502712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=c52fdd9bcc754fc0b3991af2f5ad75bf)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.504569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.507173 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 191/366] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/users/c52fdd9bcc754fc0b3991af2f5ad75bf => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:02.508015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.525553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.549340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.627196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 176/367] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:02.628500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.639392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384751-cd02-48ad-a2d3-4e40d6e0d1b3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.680160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.681525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.681819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.682523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.695250 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:02.705506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:02.706568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:02.707546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 192/368] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:02.708809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.745442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933f06-5a46-45e3-87f3-8f4e6324d46b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.776787 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.782818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.783228 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.784185 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.784393 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.784782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.787204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.788775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.791011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 177/369] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:02.791879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.830216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05408dd-08ca-4cdd-bcec-afb8d120de59 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.870757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.871954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.872462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.872959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.874115 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] RBAC: Adding query filter params (role.id=99e96b0a95f54e22931046dc4da12b0a, user.id=c52fdd9bcc754fc0b3991af2f5ad75bf, scope.system=all) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:02.874644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.876478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.891845 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 193/370] 10.222.0.71 () {56 vars in 1308 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/role_assignments?user.id=c52fdd9bcc754fc0b3991af2f5ad75bf&scope.system=all&role.id=99e96b0a95f54e22931046dc4da12b0a => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:02.893014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.910270 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7931560-ff3b-44ca-a313-eb75b20ca977 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.953298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.954496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.954630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.954943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.956366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:02.957946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:02.959897 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 178/371] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:02.960861 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.027462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06afb06-d610-4f63-99f5-e3bd73229ba6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.042215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.059169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.079858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.086211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.086211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.086211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.086211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:03.086211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.087117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d67d33-5ea5-4e22-bcda-4dc453ede021 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.088624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.104783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 194/372] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.106214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.126182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.130832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.130832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.130832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.130832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.130832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.132692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 179/373] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.133681 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.278338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774e25-f554-42b6-819d-7eb685fe7f09 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.281817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d384814-e169-4fef-8996-d39d24f78f2d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.325106 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.325784 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.326083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.326363 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.329364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.337131 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.338898 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.339392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.339680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.341217 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.343282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.346320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 195/374] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.347634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.420170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.427010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.429013 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.477125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044288a-8d18-4844-9df0-6d82520a57f1 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.521413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.522340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.524842 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.525432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.526509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=1093e61168974b61afd4a0751faf9a2f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:03.527034 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.528719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.535304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 196/375] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.536378 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.564355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 180/376] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:03.569953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.609708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.653015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb82d4c-2d1c-4529-9462-f26e873d8e84 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.672387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.688857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb6365-c91a-4d10-bc4f-34b660413c81 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.695110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.696701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.697214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.697663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.699091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=1093e61168974b61afd4a0751faf9a2f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:03.699591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.701259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.708845 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 197/377] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.729768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.730668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.730983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.731271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] PATH_INFO: `/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.732513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] RBAC: Authorizing `identity:get_project(project_id=b35e1e6e2b6d410f8c2e43cf79c90c85)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.733985 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.736135 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 181/378] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:03.741900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.882220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6c24-0681-456d-b800-70953bb74c95 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.925088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9df54-ff25-49ef-92b3-cb939a6a82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.926053 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9df54-ff25-49ef-92b3-cb939a6a82f8 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.926345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9df54-ff25-49ef-92b3-cb939a6a82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.926630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9df54-ff25-49ef-92b3-cb939a6a82f8 None admin] PATH_INFO: `/v3/groups/e7bbb1a36caf408b90d342c6d4102612` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.934384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9df54-ff25-49ef-92b3-cb939a6a82f8 None admin] RBAC: Authorizing `identity:get_group(group_id=e7bbb1a36caf408b90d342c6d4102612)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.935931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9df54-ff25-49ef-92b3-cb939a6a82f8 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.938125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 198/379] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/groups/e7bbb1a36caf408b90d342c6d4102612 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.943583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.098359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f6812-8c34-4dd8-aa1a-cb5951b3af8f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.101734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.146306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.146935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.147232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.147521 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.148386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] RBAC: Adding query filter params (group.id=e7bbb1a36caf408b90d342c6d4102612, role.id=40636a8261d645b6a2041281c7044370, scope.project.id=b35e1e6e2b6d410f8c2e43cf79c90c85) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:04.148705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.150714 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8e8b6-c50a-49e1-a3f1-73ea82d56af0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.163329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 182/380] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/role_assignments?group.id=e7bbb1a36caf408b90d342c6d4102612&scope.project.id=b35e1e6e2b6d410f8c2e43cf79c90c85&role.id=40636a8261d645b6a2041281c7044370 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.492800 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ba7b-18d0-416b-a91b-1f4a96b665f5 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.493375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ba7b-18d0-416b-a91b-1f4a96b665f5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.493375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ba7b-18d0-416b-a91b-1f4a96b665f5 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.495159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 199/381] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:04.501344 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045783d-37a8-41f3-8164-32dd65cd012f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.501688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045783d-37a8-41f3-8164-32dd65cd012f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.501931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045783d-37a8-41f3-8164-32dd65cd012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.525952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-c045783d-37a8-41f3-8164-32dd65cd012f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:04.527233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-c045783d-37a8-41f3-8164-32dd65cd012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:04.611997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 183/382] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:04.647941 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4ba7b-18d0-416b-a91b-1f4a96b665f5 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.715745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.720182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de9689-b158-437c-87c4-0c266551253b None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.722561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de9689-b158-437c-87c4-0c266551253b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.722561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de9689-b158-437c-87c4-0c266551253b None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.722561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 184/383] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:04.727408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.727705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.728001 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.748621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:04.749757 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:04.804783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4ba7b-18d0-416b-a91b-1f4a96b665f5 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.828209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 185/384] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:04.850386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.851627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.851879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.852405 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.852914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.864765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:04.874268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:04.875351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:04.876289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:04.883196 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 200/385] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:04.885661 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.898626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.059956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a06c0-2ce1-4ccc-8b4c-760e44807f8f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.077082 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210bf-e5ba-4208-b6a5-c09db4f369c6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.087138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.124346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.125168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.125461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.125750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.147293 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:05.151556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.152238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.152530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.152807 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.153579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:05.153897 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.155326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:05.167160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:05.168221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:05.169173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:05.172017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 201/386] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:05.172715 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 186/387] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:05.177595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.178873 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.314975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7149-15d5-4df2-ae21-06365f8580a7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.355630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.356472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.356769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.357056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.357826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:05.358143 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.359577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.363147 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.369600 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 202/388] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.378019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.391378 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d73fb-d229-4485-946e-62fbda7f56a8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.411163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.490166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc96ba1-93df-4b52-8ed1-a0d68ad849c1 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.507999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.509576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.509865 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.510148 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.519694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.521195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.523233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 187/389] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.533392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.535578 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.536655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.537084 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.537364 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.538610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.541151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.543158 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 203/390] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.551702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.715351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf229fc-6008-4399-be86-39c55daba804 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.728302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.737002 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157541a-fdd6-4990-8ecf-7721929068f4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.775608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.776495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.776786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.777070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.779013 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.780472 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.783387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 188/391] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.789294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.797114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.797991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.798279 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.798564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.804521 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.806515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.810228 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 204/392] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.816732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.841747 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.974875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1684f1-2f46-4fb7-bf47-aea8fb69d95f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:06.005916 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87203a92-189a-4133-8c38-c77e417db7fc None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:06.048484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a1b9a-a9f6-4b24-bcd7-591535467487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:06.049318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ec0f5-ea8c-4fbe-b301-302b8bdd31e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:06.049452 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a1b9a-a9f6-4b24-bcd7-591535467487 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.049671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a1b9a-a9f6-4b24-bcd7-591535467487 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.049947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a1b9a-a9f6-4b24-bcd7-591535467487 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/groups/130f7482fe844c8c8f677df29258ab6a/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.051018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ec0f5-ea8c-4fbe-b301-302b8bdd31e0 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.051554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ec0f5-ea8c-4fbe-b301-302b8bdd31e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.052059 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ec0f5-ea8c-4fbe-b301-302b8bdd31e0 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/groups/130f7482fe844c8c8f677df29258ab6a/roles/8fed1fbe1c3540dfa086071e3ef21c4e` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.052262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a1b9a-a9f6-4b24-bcd7-591535467487 None admin] RBAC: Authorizing `identity:create_grant(project_id=94f3cc6e099b4963a5a093333b5f04ba, group_id=130f7482fe844c8c8f677df29258ab6a, role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:06.058372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a1b9a-a9f6-4b24-bcd7-591535467487 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:06.060138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ec0f5-ea8c-4fbe-b301-302b8bdd31e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=94f3cc6e099b4963a5a093333b5f04ba, group_id=130f7482fe844c8c8f677df29258ab6a, role_id=8fed1fbe1c3540dfa086071e3ef21c4e)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:06.061608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ec0f5-ea8c-4fbe-b301-302b8bdd31e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:06.073651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 189/393] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:51:05 2022] PUT /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/groups/130f7482fe844c8c8f677df29258ab6a/roles/b7343e07f3324924a8676c7aad3628d0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:06.091014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 205/394] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:51:05 2022] PUT /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba/groups/130f7482fe844c8c8f677df29258ab6a/roles/8fed1fbe1c3540dfa086071e3ef21c4e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:06.161941 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01aa81-52c9-4d6f-822e-0beadff85ac4 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.162479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01aa81-52c9-4d6f-822e-0beadff85ac4 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.162479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01aa81-52c9-4d6f-822e-0beadff85ac4 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.164126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 190/395] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:06.170692 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.171078 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.171317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.190241 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:06.191555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:06.220806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:06.296813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 206/396] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:06.322997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01aa81-52c9-4d6f-822e-0beadff85ac4 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:06.427657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:06.448465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01aa81-52c9-4d6f-822e-0beadff85ac4 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:06.485369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:06.486194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.486484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.486767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.498003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:06.506252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:06.507356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:06.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 191/397] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:06.515479 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:06.618769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e445-66c5-40f8-a4ac-466477a5dbaa None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:06.670318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:06.671133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.671427 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.671715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.672583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:06.672909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:06.674432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:06.690452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 207/398] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:06.697070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:06.805475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0703f-e54d-4a5d-8592-77905d2bfbd0 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:06.842751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bf650-ff0a-412b-85eb-f7c6dc96273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:06.843723 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bf650-ff0a-412b-85eb-f7c6dc96273d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.844017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bf650-ff0a-412b-85eb-f7c6dc96273d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.844358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bf650-ff0a-412b-85eb-f7c6dc96273d None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.845578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bf650-ff0a-412b-85eb-f7c6dc96273d None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:06.847088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bf650-ff0a-412b-85eb-f7c6dc96273d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:06.849114 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 192/399] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:06 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:06.859926 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:06.881337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:06.986119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8e86-4e39-4540-b7ba-c8b91984875c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:06.996374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201586b-2c70-445d-9233-b029cf15dc23 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.996672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201586b-2c70-445d-9233-b029cf15dc23 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.996963 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201586b-2c70-445d-9233-b029cf15dc23 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.998357 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 193/400] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:07.016368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.016713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.016950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.043420 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:07.044639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:07.052210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.064095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.064991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.065279 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.065567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.067608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.069210 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.076213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 208/401] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:06 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:07.080862 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.199791 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 194/402] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:07.239111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.251204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.267674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea935820-6e28-440c-8aea-2be48fee2f67 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.339294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf353bd8-f0e1-4b09-b56c-d367e7ca02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.340471 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf353bd8-f0e1-4b09-b56c-d367e7ca02ce None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.340759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf353bd8-f0e1-4b09-b56c-d367e7ca02ce None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.341041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf353bd8-f0e1-4b09-b56c-d367e7ca02ce None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f/groups/130f7482fe844c8c8f677df29258ab6a/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.345449 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf353bd8-f0e1-4b09-b56c-d367e7ca02ce None admin] RBAC: Authorizing `identity:create_grant(project_id=1093e61168974b61afd4a0751faf9a2f, group_id=130f7482fe844c8c8f677df29258ab6a, role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.346968 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf353bd8-f0e1-4b09-b56c-d367e7ca02ce None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.382138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 209/403] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:51:07 2022] PUT /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f/groups/130f7482fe844c8c8f677df29258ab6a/roles/b7343e07f3324924a8676c7aad3628d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:07.397321 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511ea9-9101-4637-94fa-ae5f8bc5f0f2 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.397684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511ea9-9101-4637-94fa-ae5f8bc5f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.397980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511ea9-9101-4637-94fa-ae5f8bc5f0f2 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.400041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 210/404] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:07.408198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.408508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.408781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.419314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb4de5-9752-4dc4-9379-feee92975d2f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.432439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:07.434305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:07.474521 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.475898 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.475898 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.476129 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.489758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.494070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:07.512386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:07.513504 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:07.514461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 195/405] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:07.516461 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 211/406] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:07.522830 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.540822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.669083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.697738 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7c10-c4f2-460b-ba1a-2cb8015a53c6 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.711649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3f9ee-2e42-4488-bf77-5853605c6e17 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.745558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.746292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.746586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.746897 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.751063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.752032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.752494 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.752943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.753882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] RBAC: Adding query filter params (name=member) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:07.754374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.756153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.758336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:07.766356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:07.767472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:07.768551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 212/407] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:07.770415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 196/408] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:07.774631 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.776594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.855246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.900531 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278e62-b1db-4978-9eb1-648d46867f7a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.925838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901aed1-10a1-4787-b5dd-754b202d70af None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.962401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.963125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.963483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.963775 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.964600 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:07.965185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.966590 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.968026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.975553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.976526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.976975 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.977700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.979011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.979450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 213/409] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:07.981930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.987689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 197/410] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:07.988013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.994216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.095697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab41f8-89d9-4dfb-8957-edbc082c2915 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.136861 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.137744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.138028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.138306 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] PATH_INFO: `/v3/groups/e7bbb1a36caf408b90d342c6d4102612` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.147614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] RBAC: Authorizing `identity:get_group(group_id=e7bbb1a36caf408b90d342c6d4102612)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.149737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.151520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 214/411] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/groups/e7bbb1a36caf408b90d342c6d4102612 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:08.157168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.202581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66b28-d52d-4d8d-af1a-e4557f4b7713 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.233740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.247519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.248786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.249305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.249821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.251351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.253054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.259508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 198/412] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:08.265215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.283973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.362552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac25af5-eec5-4491-aec7-7cb6f295032d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.420883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e13190-25e1-43d6-a48c-b2fe95ee179d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.442465 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.443372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.443658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.443935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] PATH_INFO: `/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.447336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] RBAC: Authorizing `identity:get_project(project_id=b35e1e6e2b6d410f8c2e43cf79c90c85)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.448840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.450601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 215/413] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:08 2022] GET /identity/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85 => generated 344 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:08.459455 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.493355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08647ed-564f-4bbe-90a3-bc735979379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.494292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08647ed-564f-4bbe-90a3-bc735979379b None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.494578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08647ed-564f-4bbe-90a3-bc735979379b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.494886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08647ed-564f-4bbe-90a3-bc735979379b None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f/groups/130f7482fe844c8c8f677df29258ab6a/roles/8fed1fbe1c3540dfa086071e3ef21c4e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.496926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08647ed-564f-4bbe-90a3-bc735979379b None admin] RBAC: Authorizing `identity:create_grant(project_id=1093e61168974b61afd4a0751faf9a2f, group_id=130f7482fe844c8c8f677df29258ab6a, role_id=8fed1fbe1c3540dfa086071e3ef21c4e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.498381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08647ed-564f-4bbe-90a3-bc735979379b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.516089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 199/414] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:51:08 2022] PUT /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f/groups/130f7482fe844c8c8f677df29258ab6a/roles/8fed1fbe1c3540dfa086071e3ef21c4e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:51:08.611367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba78ba3-88a5-45fd-bd95-cacff41dd36e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.664047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.670188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c070-ef15-4d5e-adf1-e7bf141475db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.671254 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c070-ef15-4d5e-adf1-e7bf141475db None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.671637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c070-ef15-4d5e-adf1-e7bf141475db None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.671920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c070-ef15-4d5e-adf1-e7bf141475db None admin] PATH_INFO: `/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85/groups/e7bbb1a36caf408b90d342c6d4102612/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.675164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0c070-ef15-4d5e-adf1-e7bf141475db None admin] RBAC: Authorizing `identity:create_grant(project_id=b35e1e6e2b6d410f8c2e43cf79c90c85, group_id=e7bbb1a36caf408b90d342c6d4102612, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.676630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0c070-ef15-4d5e-adf1-e7bf141475db None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.717847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 216/415] 10.222.0.71 () {58 vars in 1442 bytes} [Thu May 19 14:51:08 2022] PUT /identity/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85/groups/e7bbb1a36caf408b90d342c6d4102612/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:08.816084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bac77-46aa-499f-8330-2a3962d81f5f None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.816448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bac77-46aa-499f-8330-2a3962d81f5f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.816654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bac77-46aa-499f-8330-2a3962d81f5f None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.818372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 200/416] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:08.824235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e98f1-0f30-4d12-9506-ed2c92b847d6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.824601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e98f1-0f30-4d12-9506-ed2c92b847d6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.824803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e98f1-0f30-4d12-9506-ed2c92b847d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.846539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-a99e98f1-0f30-4d12-9506-ed2c92b847d6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:08.847827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-a99e98f1-0f30-4d12-9506-ed2c92b847d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:08.930610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 217/417] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:08.967711 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bac77-46aa-499f-8330-2a3962d81f5f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.058828 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.122766 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bac77-46aa-499f-8330-2a3962d81f5f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.163903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881dd44-2182-4f5d-a096-b3fa55c1dac7 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.165118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881dd44-2182-4f5d-a096-b3fa55c1dac7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.165638 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881dd44-2182-4f5d-a096-b3fa55c1dac7 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.167583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 218/418] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:09.170822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.170822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.170822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.170822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.173353 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.173878 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.174377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.186179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:09.199104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:09.200152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:09.201078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:09.209227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:09.210714 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:09.217495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 201/419] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:09.220805 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.313283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 219/420] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:09.374242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.422285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b423f-7c92-410f-9b90-40b0fc5efc96 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.449276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.450169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.493184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.493885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.494178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.494473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.495284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:09.495603 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.496988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.502694 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd969bb-5e0b-4508-ba39-01cb95913558 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.521382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 202/421] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:09.540021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.554984 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.555815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.556108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.556396 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.571169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:09.579555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:09.580626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:09.581551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:09.584566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 220/422] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:09.596024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.720988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a5ded-ccbb-44c8-b270-2625c601dc6e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.771553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eb448-69f4-4947-9f16-b8d6c1a72675 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.796368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.802519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.803231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.803522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.803811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.837294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.837989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.838281 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.838564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.839366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:09.839946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.841363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.863768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 221/423] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:09.870345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.905460 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.948029 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.949542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.071158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 203/424] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:10.076744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.108921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdc97-4a2f-43a9-b197-a5b2d1eee9fd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.161749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc68ecb-82b2-4f2c-9d35-f8368efd2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.163213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68ecb-82b2-4f2c-9d35-f8368efd2d87 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.163631 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68ecb-82b2-4f2c-9d35-f8368efd2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.163926 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68ecb-82b2-4f2c-9d35-f8368efd2d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.165976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.188918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379ad6-32b8-4e29-ab77-ff4470801ea4 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.227933 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.240419 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e002-7ab6-4ee2-82fe-e4c8fe0e3bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.241310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e002-7ab6-4ee2-82fe-e4c8fe0e3bb3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.241602 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e002-7ab6-4ee2-82fe-e4c8fe0e3bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.241893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e002-7ab6-4ee2-82fe-e4c8fe0e3bb3 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.243705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e002-7ab6-4ee2-82fe-e4c8fe0e3bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.245181 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e002-7ab6-4ee2-82fe-e4c8fe0e3bb3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.247302 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 204/425] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:10.248589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a633c9-c0ef-4783-9dd9-3f3ffbdffba8 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.248889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a633c9-c0ef-4783-9dd9-3f3ffbdffba8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.249179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a633c9-c0ef-4783-9dd9-3f3ffbdffba8 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.250560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 205/426] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:10.252506 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a633c9-c0ef-4783-9dd9-3f3ffbdffba8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.270730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc68ecb-82b2-4f2c-9d35-f8368efd2d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.272971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc68ecb-82b2-4f2c-9d35-f8368efd2d87 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.382855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a633c9-c0ef-4783-9dd9-3f3ffbdffba8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.402993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 222/427] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:10.404511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.404813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.405098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.422685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:10.423936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:10.432084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.433377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.433671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.433957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.435194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.437313 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.442942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 206/428] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.444137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.469352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.505005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 223/429] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:10.505938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.513989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.596063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6371c-3f8f-4743-b967-df66d7e94a82 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.632208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc2be-45ca-4dc0-9755-3adb321b6eb2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.642765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.644127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.644417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.644699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] PATH_INFO: `/v3/projects/94f3cc6e099b4963a5a093333b5f04ba` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.646471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] RBAC: Authorizing `identity:get_project(project_id=94f3cc6e099b4963a5a093333b5f04ba)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.648390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.651184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 207/430] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/projects/94f3cc6e099b4963a5a093333b5f04ba => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.655747 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.675865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.676673 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.676963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.677242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.678149 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:10.678470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.681029 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.691204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 224/431] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.691204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.845124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.862630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.879836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93bccc-a1bc-448d-a12d-796842dc4a79 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.929627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3673-8dd2-42e8-a48a-30209e2d33e0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.946125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.947239 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.947526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.947805 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.964080 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:10.972414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.973291 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.973575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.973856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:10.974748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:10.977537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:10.979780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:10.981352 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.981352 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.981352 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 225/432] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.986341 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.986761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 208/433] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:10.988709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.134249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0303f-5f67-4054-9d21-7eea28a96d48 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.139142 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b504ee-03ca-4442-b1af-79914d14da84 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.175388 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.176361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.176817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.177277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.178203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:11.178688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.180375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.183122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.192282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 226/434] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:11.198728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.198728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.198728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.198728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.199218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=94f3cc6e099b4963a5a093333b5f04ba) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:11.199218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.200164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556c1d-1c51-4895-ad51-4133db3153b2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.201518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.208067 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 209/435] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=94f3cc6e099b4963a5a093333b5f04ba&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:11.304668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57f70-39d1-4ee2-a833-f2d567e36332 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.305395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57f70-39d1-4ee2-a833-f2d567e36332 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.305395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57f70-39d1-4ee2-a833-f2d567e36332 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.310776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 210/436] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:11.312456 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c156e4c-4f46-4a0d-987a-760b8008afaf None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.312919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c156e4c-4f46-4a0d-987a-760b8008afaf None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.313396 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c156e4c-4f46-4a0d-987a-760b8008afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.323049 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe33fb-08d1-43ae-9a82-5cc523053634 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.332130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-2c156e4c-4f46-4a0d-987a-760b8008afaf None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:11.333791 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-2c156e4c-4f46-4a0d-987a-760b8008afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:11.347261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.367648 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.368339 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.368627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.368906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.429857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 211/437] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:11.439377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742ab03-9ddb-4c6f-baf8-b764a821cf0d None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.439678 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742ab03-9ddb-4c6f-baf8-b764a821cf0d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.439973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742ab03-9ddb-4c6f-baf8-b764a821cf0d None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.441420 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 212/438] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:11.448425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.448725 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.449016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.449168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.455148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.458271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.468791 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:11.470020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:11.557583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 213/439] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:11.558544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.582805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 227/440] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:11.584735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.641736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.683382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774754a-c3f5-4633-a21c-eb5409dd6fd3 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.705591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.710232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329d3b5-34e5-4571-9306-a929ecb05b40 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.723485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.724300 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.724643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.725090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.735961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:11.744720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:11.745969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:11.747081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:11.749281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 214/441] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:11.750242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.752374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.753169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.753453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.753727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.766880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:11.775956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:11.777186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:11.778177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 228/442] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:11.778970 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.857757 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590f43-2b9c-4d4d-80b8-a85c0d474d2f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.884762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.888268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab22a-f27f-4a43-a657-fa764cab82dc None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.893166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.894032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.894315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.894592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.895853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.897305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.899635 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 215/443] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:11.900392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.926942 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.927625 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.927919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.928205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.928963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] RBAC: Adding query filter params (name=member) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:11.929285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.930699 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.939148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 229/444] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:11.939955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.962574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.001532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892f74-6751-40b7-b965-f53893b7dbfa None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.037531 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.038238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.038533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.038849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.039620 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:12.039939 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.041335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.047443 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74170-71e2-4c90-b839-891f9961d266 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.049658 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 216/445] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:12.050456 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.081550 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.082425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.082717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.083042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.084248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.085712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.087982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 230/446] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:12.088756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.109542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.153264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf41f1-7ee1-4b85-863e-e81b9f42c675 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.175209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.186338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.187020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.187310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.187523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b344bc3-fd7d-43ee-a6bb-8532761b1a64 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.187626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.221236 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.221823 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.222116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.222407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.254351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.256087 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.288575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.290109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.314158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.356187 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 217/447] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:12.360871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.382722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.397924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 231/448] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:12.398760 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.457753 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81d61-b4f2-4350-8848-a3618e3e4946 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.491841 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.493281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.493566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.493973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.494821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=1093e61168974b61afd4a0751faf9a2f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:12.495160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.496613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.498878 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eccdc3-9a96-4813-935d-70f91d4f074c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.502379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 218/449] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:12.503189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.531426 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.539976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.541609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.541900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.542180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] PATH_INFO: `/v3/projects/1093e61168974b61afd4a0751faf9a2f` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.543528 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] RBAC: Authorizing `identity:get_project(project_id=1093e61168974b61afd4a0751faf9a2f)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.546339 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.552947 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 232/450] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/projects/1093e61168974b61afd4a0751faf9a2f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:12.553859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.624293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.626604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ffc3-5030-4d16-9ef1-93ad4a510773 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.664354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.665250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.665536 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.665815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] PATH_INFO: `/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.667126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] RBAC: Authorizing `identity:get_project(project_id=b35e1e6e2b6d410f8c2e43cf79c90c85)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.668593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.675045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 219/451] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/projects/b35e1e6e2b6d410f8c2e43cf79c90c85 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:12.676000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.682665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844859df-0b29-4102-b5ea-54efc593a939 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.725423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.726397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.727237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.727569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] PATH_INFO: `/v3/groups/130f7482fe844c8c8f677df29258ab6a` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.730507 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] RBAC: Authorizing `identity:get_group(group_id=130f7482fe844c8c8f677df29258ab6a)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.732076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.733897 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 233/452] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/groups/130f7482fe844c8c8f677df29258ab6a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:12.739488 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.777786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.787919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06920-1af6-42ee-b8d9-0ef99c26445d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.822184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.823083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.823377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.823665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] PATH_INFO: `/v3/groups/e7bbb1a36caf408b90d342c6d4102612` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.824894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] RBAC: Authorizing `identity:get_group(group_id=e7bbb1a36caf408b90d342c6d4102612)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.826343 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.828153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 220/453] 10.222.0.71 () {56 vars in 1180 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/groups/e7bbb1a36caf408b90d342c6d4102612 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:12.833822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.840560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ed631-f7b7-4b20-9d91-31791e042198 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.864477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.876642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.877315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.877599 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.877881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.878710 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] RBAC: Adding query filter params (group.id=130f7482fe844c8c8f677df29258ab6a, role.id=8fed1fbe1c3540dfa086071e3ef21c4e, scope.project.id=1093e61168974b61afd4a0751faf9a2f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:12.879060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.880500 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817ded5-7ad8-41a9-837d-80cd9646d3a5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.886192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 234/454] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/role_assignments?group.id=130f7482fe844c8c8f677df29258ab6a&scope.project.id=1093e61168974b61afd4a0751faf9a2f&role.id=8fed1fbe1c3540dfa086071e3ef21c4e => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:12.936765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abe04a-1f9b-4cb9-9cf6-be1f011f7941 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.972530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.973200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.973491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.973776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.974636 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] RBAC: Adding query filter params (group.id=e7bbb1a36caf408b90d342c6d4102612, role.id=40636a8261d645b6a2041281c7044370, scope.project.id=b35e1e6e2b6d410f8c2e43cf79c90c85) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:12.974990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.976462 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee301-a950-4643-aa6c-1f61f5152970 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.983696 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 221/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/role_assignments?group.id=e7bbb1a36caf408b90d342c6d4102612&scope.project.id=b35e1e6e2b6d410f8c2e43cf79c90c85&role.id=40636a8261d645b6a2041281c7044370 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:15.790432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c6aa6-98fc-4404-ae1b-1259a2a5aea6 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.791047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c6aa6-98fc-4404-ae1b-1259a2a5aea6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.791047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c6aa6-98fc-4404-ae1b-1259a2a5aea6 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.792809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 235/456] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:15.798715 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecfe0b-f359-4d18-9b9f-31fe383ac04b None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.799692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecfe0b-f359-4d18-9b9f-31fe383ac04b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.800227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecfe0b-f359-4d18-9b9f-31fe383ac04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.818870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-b1ecfe0b-f359-4d18-9b9f-31fe383ac04b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:15.820499 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-b1ecfe0b-f359-4d18-9b9f-31fe383ac04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:15.840251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.894854 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 222/457] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:15.919457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c6aa6-98fc-4404-ae1b-1259a2a5aea6 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.060136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c6aa6-98fc-4404-ae1b-1259a2a5aea6 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.105530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.106346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.106633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.106951 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.125757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.127308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:16.146125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:16.147200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:16.148182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:16.148182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:16.148182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:16.148182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:16.149634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 236/458] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:16.150817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b88bb4-971e-4c00-bec5-dc22c765c816 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.151053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b88bb4-971e-4c00-bec5-dc22c765c816 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.151345 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b88bb4-971e-4c00-bec5-dc22c765c816 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.152992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 223/459] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:16.156572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.161866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08526-49f4-482c-988c-0dcd1260e62b None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.162172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08526-49f4-482c-988c-0dcd1260e62b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.162466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08526-49f4-482c-988c-0dcd1260e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.185041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-f2a08526-49f4-482c-988c-0dcd1260e62b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:16.186944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-f2a08526-49f4-482c-988c-0dcd1260e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:16.213265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.265401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 224/460] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:16.267052 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063974-23a5-4292-bcc3-a9040f7f8711 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.267514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063974-23a5-4292-bcc3-a9040f7f8711 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.267810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063974-23a5-4292-bcc3-a9040f7f8711 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.269827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 225/461] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:16.275693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.276223 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.276658 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.281131 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517108e-7ff2-4ff5-b039-3ebc047b2c6a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.294228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:16.295825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:16.320752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.321545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.321841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.322276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.324069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:16.325101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.329443 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.345293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 237/462] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.347240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.386195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 226/463] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:16.387462 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.402584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.480291 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.482743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7346d11-2689-4ed2-8307-d575d6ab4698 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.521246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.521975 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa05d4-851d-43d8-8165-2e987d02bbe1 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.522759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.524185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.524831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.539137 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.541680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:16.563903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:16.564916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:16.565909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:16.565909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:16.565909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:16.565909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:16.567694 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 238/464] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:16.568613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.569235 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.570721 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.571347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.571847 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.572769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.574455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.598530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 227/465] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:51:16 2022] POST /identity/v3/users => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:16.599947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.695337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.732981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c95d8-1f99-4e9f-9253-f7ba64791bb9 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.753897 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08e20-70fa-4a78-bc8d-f925343cdebd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.775320 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.776405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.776919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.777499 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.778443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:16.778986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.780719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.796330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 228/466] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.801916 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.835274 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.838092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.838698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.839280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.854865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.857300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:16.881098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:16.882176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:16.883227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:16.883227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:16.883227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:16.883227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:16.883227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 239/467] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:16.890064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.899315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.959710 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86586c-3aee-4eba-be18-56e108964de4 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.994943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.010747 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23254f5f-e638-4264-9ef7-3d9054c97224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.011608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23254f5f-e638-4264-9ef7-3d9054c97224 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.011964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23254f5f-e638-4264-9ef7-3d9054c97224 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.012321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23254f5f-e638-4264-9ef7-3d9054c97224 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.013126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23254f5f-e638-4264-9ef7-3d9054c97224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.016330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23254f5f-e638-4264-9ef7-3d9054c97224 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.034253 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa3f77-2fa5-459f-b4c4-b93a2c17e93e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.048527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 229/468] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:51:16 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:17.050366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c9723-a6e3-44d2-9020-ff66b3d83541 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.051000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c9723-a6e3-44d2-9020-ff66b3d83541 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.051542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c9723-a6e3-44d2-9020-ff66b3d83541 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.053473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 230/469] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:17.059558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.060182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.060687 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.081146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:17.082954 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:17.097215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.097824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.098116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.098400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.099304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:17.099494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.100923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.129558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 240/470] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.129930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.169524 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 231/471] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:17.219693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.238666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.283093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aa754-3275-4e19-af26-28f010e4ce5c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.355681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.356275 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.356572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.357170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.357573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.359078 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.377750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ac76-ee1d-4049-a51c-17bf2ae779f4 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.391038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 241/472] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:17.401007 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.428894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.430899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.431606 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.432077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.445520 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.447303 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-4b8a79fd-f1e1-4f2c-bb70-a871fcfd8e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:17.468430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:17.469718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:17.470923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:17.470923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:17.470923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:17.470923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:17.473098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 232/473] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:17.479345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.495770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f0da0-1ad7-490a-b02e-ca0d703d4f03 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.496314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f0da0-1ad7-490a-b02e-ca0d703d4f03 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.497226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f0da0-1ad7-490a-b02e-ca0d703d4f03 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.499512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 233/474] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:17.505609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.506164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.506611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.530484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:17.531772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:17.624493 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038746b-cdf9-48db-9669-8fc428ccdd62 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.626172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 234/475] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:17.646984 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.649956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.667983 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.670815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.670815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.670815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.670815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:17.670815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.671686 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.687397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 242/476] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.693714 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.776664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.784001 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc7578-75e6-410d-87cc-bd677fc9987a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.806879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4072-a4ce-4b4b-b831-2d53ad916f8b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.821701 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.823177 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.823657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.824222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.825221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.826867 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.835110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.sql.core [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:51:17.835110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:51:17.835110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [parameters: {'id': '82b62c4455c44d3986707cc6a0fdbcf8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:51:17.835110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=270180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:51:17.845779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.845779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.846325 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.846325 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.847091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.848635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application conn.query(q) May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result.read() May 19 14:51:17.855523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return ref.to_dict() May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:51:17.856565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application next(self.gen) May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application yield resource May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application next(self.gen) May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise self.value May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application session.commit() May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:51:17.857682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.session.flush() May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application compat.raise_( May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:51:17.858838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:51:17.859887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application conn.query(q) May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result.read() May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:51:17.860866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [parameters: {'id': '82b62c4455c44d3986707cc6a0fdbcf8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:17.861768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:51:17.862744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:17.865585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 235/477] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/roles => generated 144 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:17.873038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.880137 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 243/478] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:51:18.009325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fae2a-f18b-41b5-af5f-cbeeb2502816 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.053718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b31cb-de03-4a3b-8302-841c99b42a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.055708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b31cb-de03-4a3b-8302-841c99b42a21 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.056240 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b31cb-de03-4a3b-8302-841c99b42a21 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.056734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b31cb-de03-4a3b-8302-841c99b42a21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.069675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b31cb-de03-4a3b-8302-841c99b42a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-6f5b31cb-de03-4a3b-8302-841c99b42a21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:18.079298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:18.080404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:18.081359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:18.084233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 236/479] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:18.090346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.129186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.200575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe37b2-078c-4dc8-a320-e9bf7377bc41 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.235701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.236390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.236676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.236955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.237722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:18.238035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.239457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0861b-2adc-4f49-9737-67ddae5c93ee None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.249086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 244/480] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.369968 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff128474-f897-4255-9118-5fb4a8f4e57c None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.370731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff128474-f897-4255-9118-5fb4a8f4e57c None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.370731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff128474-f897-4255-9118-5fb4a8f4e57c None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.372403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 237/481] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:19.378817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.379499 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.379499 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.397088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:19.398854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:19.470118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 245/482] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:19.510083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff128474-f897-4255-9118-5fb4a8f4e57c None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.538375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.647584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff128474-f897-4255-9118-5fb4a8f4e57c None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.701370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.702184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.702753 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.719739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:19.727535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:19.728595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:19.729584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 238/483] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:19.734766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.772992 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.864565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e00c2-f95d-49b9-be7b-15732330a7fc None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.914074 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.914673 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.914990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.915273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.916036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:19.916350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.917743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.930991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 246/484] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.936681 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.041185 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.053354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb202a-5bdb-446a-9a09-f5c6645e9fbd None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.088927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.090001 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.090286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.090567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.101500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:20.103005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-602a5115-423e-459c-be06-a93f9258b1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:20.120729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:20.121838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:20.123366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:20.123366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:20.123366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:20.123366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:20.127344 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 239/485] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:20.128057 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.236297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8926b0e-ae7f-4871-9835-94eb8aa1f6b7 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.236659 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8926b0e-ae7f-4871-9835-94eb8aa1f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.236870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8926b0e-ae7f-4871-9835-94eb8aa1f6b7 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.239290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 240/486] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:20.241100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a21b-f4be-4d6f-801e-c69c25537684 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.241396 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a21b-f4be-4d6f-801e-c69c25537684 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.241683 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a21b-f4be-4d6f-801e-c69c25537684 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.246092 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 241/487] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:20.247612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.247969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.248331 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.266927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:20.268257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:20.269005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.281839 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9084-583c-41a5-a81a-c9369106c32b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.324404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.325110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.325402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.325689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.326456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:20.326779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:20.328236 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b77229-199a-4546-b450-ff27b34ad922 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:20.344733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 247/488] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:20.346064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.346358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.346648 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.358938 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 242/489] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:20.360075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.367683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:20.368997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:20.456677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.458755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 248/490] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:20.459671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.507945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222c3-ab78-443e-a458-501c5d4f363a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.545932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.546742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.547060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.547448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.556223 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:20.557688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:20.575582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:20.576744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:20.577845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:20.581765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.581966 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 243/491] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:20.583751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.601923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c964452-c3a2-4904-bde0-93c62093a72a None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.645214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.646042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.646331 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.646997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.658813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:20.669774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:20.671089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:20.672294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:20.676104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 249/492] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:20.676885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.702095 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9055c-96e7-46f5-902a-0bc252718538 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.727353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.741349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.742990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.743448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.743993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.755482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:20.768583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:20.770511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:20.772308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:20.776792 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 244/493] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:20.778351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.805494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c826-ed90-4b4c-a3e0-d49b296562ea None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.848199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.848888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.849182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.849469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.850330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:20.851080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:20.852389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:20.880149 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.899736 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 250/494] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:20.900748 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:20.905733 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2fbb-25bc-430b-afdc-fedfba8e2cd7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:20.943074 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.944064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.944523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.945013 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.946555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:20.947041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:20.948722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:20.962590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 245/495] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:20.963768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.013511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.013757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81b77d-0caf-4310-a859-d57c78c3ec23 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.051860 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.052459 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.052750 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.053035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.053801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:21.054117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.056249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.069365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 251/496] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:21.069365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.077155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0ea1-73bb-46d8-ab85-7d90852459a9 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.112297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.112963 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.113252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.113819 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.133299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.177630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf868b-8dc3-4fbe-af9a-d37ff22ab616 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.189110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.190415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.216634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.217440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.217737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.218019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.228865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.230351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.238118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-ed26f94e-5868-4002-be98-5539b73a82ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:21.248698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:21.249721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:21.250677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:21.250677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:21.250677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:21.250677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:21.250677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 252/497] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:21.251558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117759ca-d758-4e92-9122-76fc92f2f741 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.251558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117759ca-d758-4e92-9122-76fc92f2f741 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.251805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117759ca-d758-4e92-9122-76fc92f2f741 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.253192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 253/498] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:21.253695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117759ca-d758-4e92-9122-76fc92f2f741 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.305870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 246/499] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:21.306487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.370601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117759ca-d758-4e92-9122-76fc92f2f741 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.385326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.408824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.409628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.409920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.410205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.413220 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f018a2f-7e23-4e05-b99f-b1ee4c140cd8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.421068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.422572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-4a309763-5ae6-451f-ac28-93c4a4adc3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:21.440712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:21.441744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 254/500] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.448035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.458046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.458766 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.459100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.459368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.460106 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:21.460438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.461840 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.464796 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:21.466095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:21.478810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 247/501] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:21.478810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.480772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.548866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 255/502] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:21.548866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.585781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf118c-4584-4c56-806a-d0e18c4b0688 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.620509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.621309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.621605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.621885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.635328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.636177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.636807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.643574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929d70c-f2ef-4ffd-8534-3971183123ab None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:21.654931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:21.655921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:21.656924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:21.656924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:21.656924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:21.656924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:21.656924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 248/503] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:21.656924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.681366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.682021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.682307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.682582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.683334 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:21.683647 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.685033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7425-4448-420e-856d-9501cd2ccc67 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.697059 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 256/504] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:21.698410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330009fc-61fb-4afd-ba5d-f7b3dab0fc53 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.698827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330009fc-61fb-4afd-ba5d-f7b3dab0fc53 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.699222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330009fc-61fb-4afd-ba5d-f7b3dab0fc53 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.700579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 257/505] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:21.701546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330009fc-61fb-4afd-ba5d-f7b3dab0fc53 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.718403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.765217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84eb2d-95c3-48ce-97ce-b279b4c86a9b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.800962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.801761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.802047 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.802156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330009fc-61fb-4afd-ba5d-f7b3dab0fc53 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.802338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.810289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.811786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:21.825559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:21.831434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 249/506] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:21.832807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.837290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.838038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.838329 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.838608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.849058 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:21.857508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:21.858702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:21.859834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 258/507] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:21.860757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.876261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.931944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b07fb-533d-4fda-9ca3-d5c944084213 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.947758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.959492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494bb7-7ea9-4e18-bc92-0281dc6a587b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.966040 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.966713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.967030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.967358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.968082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:21.968392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:21.969798 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85794-3341-427f-99d1-f334ff281e2d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:21.982044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 250/508] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:21.983418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.983724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.983990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.997353 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.998152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.998439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.998717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.000482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:22.001703 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:22.007223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.008710 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:22.024423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:22.025627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 259/509] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:22.031816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.079261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 251/510] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:22.080634 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.102633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.128591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f914-07ee-4059-b19b-4843d0a020ee None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.162267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.162979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.163275 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.163558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.164985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.165301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.166762 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.183359 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 260/511] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.184155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.190815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f8165-bdcf-4755-95be-5a008ffc7a14 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.198243 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.225207 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.225901 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.226714 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.227047 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.227806 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.228123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.229500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.237436 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 252/512] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.238216 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.286852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6d8f1-4f0b-432a-81a8-7ef9d7b31819 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.316437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.322202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.323113 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.323404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.323689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.330429 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.331942 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.339753 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422c78-d078-452b-ac4a-a6ec398fbb49 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:22.347147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:22.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:22.349314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 261/513] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:22.349877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.376143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.376751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.377042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.377321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.378160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.378470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.379952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.418195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 253/514] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.419038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.446678 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.454327 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9cb15-b409-4039-ae32-8a4f2b09d0ed None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.490048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.490881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.491174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.491457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.502107 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.503723 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:22.521230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:22.522401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:22.524348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:22.524348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:22.524348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:22.524348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:22.524348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 262/515] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:22.524348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.529321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66a47-6dfa-4d93-91d0-28cb54b494b5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.563981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.564642 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.564939 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.565224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.571608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.627122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6668-9bb9-41ba-afcd-641a82ab1480 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.635640 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.637468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.661361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.662159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.662454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.662731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.663983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.673550 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.675057 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:22.691972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:22.693122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:22.694539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:22.694539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:22.694539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:22.694539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:22.694539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 263/516] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:22.694539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.742344 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 254/517] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:22.743391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.788663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.798969 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc0c42-564b-4518-a916-e72d81dd952e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.834771 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.835500 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.835789 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.836073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.836944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.837265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.838736 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.849866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056f9c0-8d11-4363-9af6-9da9e2981d88 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.856589 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 264/518] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.857408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.876338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.885761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.886350 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.886641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.886956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.953666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.955169 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.955341 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e766-4710-4bee-916b-5f4bdb6b4977 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.990274 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.990978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.991271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.991554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.992317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.992708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.994105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.005618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 265/519] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.006430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.026579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.064509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 255/520] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:23.064509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.089521 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.113025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc391c8-9d75-4771-b58b-0d5956f8a22b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.153954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.154877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.155311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.155730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.156869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.157341 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.159555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.166808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b0388-57ab-42c7-a6c1-cabc7cb11024 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.181962 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 266/521] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.181962 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.206340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.207183 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.207475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.207765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.218405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.219911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:23.237857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:23.238929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:23.239947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:23.239947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:23.239947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:23.239947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:23.239947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 256/522] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:23.239947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.262689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.285427 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243c1d-f913-4b06-96be-d19640ee7de6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.320492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.320718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.321283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.321725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.321934 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.323187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=8088e85aab0b4adcb6c53d99a531515c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.323515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.324966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.330408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 267/523] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/role_assignments?user.id=8088e85aab0b4adcb6c53d99a531515c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.331238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.345160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecd96c-9398-44dc-b0e3-c4724225b3bf None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.384663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.385371 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.385666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.385953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.386692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.388260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.420993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 257/524] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:51:23 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:23.420993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.460073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b044-10b0-4bb1-b76f-30c021abe84a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.511766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.512787 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.513295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.513688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.525140 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.529154 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.530982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:23.553980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:23.555936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:23.557142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:23.557142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:23.557142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:23.557142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:23.558505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 268/525] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:23.560353 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.575100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7050cff-2abb-46f1-83eb-24c86b6cfed1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.626063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.627527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.628006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.628708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.632157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.643893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.644733 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:23.663434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:23.665338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:51:23.666584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:23.672789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 258/526] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:23.672789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.707200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e0d20-2dae-4e3b-a62c-8d6ab47b2479 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.751106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.752036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.752662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.752956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.753733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.754054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.755501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.768740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 269/527] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.769859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.809116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bab285-0ab2-407a-85d8-702e366c6431 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.829633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.846002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.846877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.847281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.847676 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.848569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.849060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.850643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.864911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 259/528] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.870773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.894215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5859ebd-969c-483e-935f-2e5a4a622636 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.939808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.940512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.941132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.941425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.942585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.942951 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.944595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.967218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.968954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 270/529] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.969624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.990088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99417ad-e5c0-4663-b354-0827ee272417 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.031671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.032758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.033264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.033787 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.041649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.043621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:24.059250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:24.060309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:24.061309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:24.064293 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 260/530] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:24.065484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.097305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05d79-d6c3-445d-a98f-8232a6a876f3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.112618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:24.144930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.146036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.146340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.146614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.159672 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.161660 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:24.179979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:24.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:24.182025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:24.186090 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 271/531] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:24.187316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.190503 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef4acc-f9ff-47f7-99a9-9051bd629df5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.208399 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:24.232912 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.233947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.234498 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.235048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.312223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba17c-c3fe-4e8b-9d52-5603ec4e0dce None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.322459 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.324482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.354252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.354978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.355272 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.355554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.356656 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:24.356981 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.359173 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.377659 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 272/532] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:24.378941 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.420808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:24.442621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 261/533] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:24.443817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.461409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:24.534384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632e07-8b2e-41ec-8253-69150dcca6c9 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.572040 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.572721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.573009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.573293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.574090 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:24.574409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.574661 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a7ea4-1b6d-45e9-a6a9-5bb09bca9bc3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.575902 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.588454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 273/534] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:24.589482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.616298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.617025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.617278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.617556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.618402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=047e7992883f471384163db5570ed52b) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:24.618720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.621074 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.630864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 262/535] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/role_assignments?user.id=047e7992883f471384163db5570ed52b&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:24.632069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.751687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:24.762872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf129db-82ca-4d40-8bd6-fba3226cec9d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.811680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.812503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.812791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.813069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.837105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.838682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.839824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:24.865777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:24.867520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:24.868512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:24.868512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:24.868512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:24.868512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:24.868512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 274/536] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:24.873609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.899574 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92972f-6505-4563-acd1-2c1d639e6581 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:24.945431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:24.946015 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.946282 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.946568 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.947454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=ac644ec1ab294fb7813be6036edfef7f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:24.947774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:24.950447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:24.956980 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 263/537] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/role_assignments?user.id=ac644ec1ab294fb7813be6036edfef7f&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:25.010231 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411926-ac88-4001-843e-c1e882897ce9 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.050258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.051362 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.051958 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.052459 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.053423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:25.053980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.056209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.070703 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 275/538] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:25.078673 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.215917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a67f05-d92b-4293-9b64-c1fd044de3aa None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.252260 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.253073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.253359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.253635 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.260941 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.262328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:25.277348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:25.278391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:25.279448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:25.282902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 264/539] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:25.284844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.290826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.434566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd643-6f44-4aac-903d-6e159157c8bd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.488781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.489874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.490384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.490926 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.492023 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:25.492592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.494392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b08f3-d102-43e1-9d94-e940641248c5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.519268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 276/540] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:25.524481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.533655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.677878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221743eb-4fe2-47a8-a470-905b97bec570 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.705238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fd29d-054c-4234-a5f9-1d9f05a72378 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.705765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fd29d-054c-4234-a5f9-1d9f05a72378 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.705882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fd29d-054c-4234-a5f9-1d9f05a72378 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.707409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 277/541] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:25.713360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790e3f-4410-44b0-9899-1396041115dc None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.713952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790e3f-4410-44b0-9899-1396041115dc None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.714713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790e3f-4410-44b0-9899-1396041115dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.743163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0d790e3f-4410-44b0-9899-1396041115dc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:25.746048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0d790e3f-4410-44b0-9899-1396041115dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:25.753716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.759909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.760712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.761221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.762350 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=9858c1681f0e4afa9270642c5b22122f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:25.762929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.764704 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.772265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 265/542] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/role_assignments?user.id=9858c1681f0e4afa9270642c5b22122f&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:25.858909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.873606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 278/543] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:25.920583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.961622 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da63e1-eea8-4203-bdfe-05ab5686865c None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.961924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da63e1-eea8-4203-bdfe-05ab5686865c None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.962211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da63e1-eea8-4203-bdfe-05ab5686865c None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.963924 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 279/544] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:25.971325 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.971639 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.971927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.010655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:26.012143 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:26.023214 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.074931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436b31-51ad-4fc4-bb98-324af2057397 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.114743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 280/545] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:26.128677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.129832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.130373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.130915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.140070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.151395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:26.168023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:26.169155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:26.170073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:26.170780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 266/546] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:26.175103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.294011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b144cc-7950-41a5-b487-a1eec400d7d7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.323677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.341136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.342164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.342661 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.343171 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.344133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:26.345695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.347359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.367456 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 267/547] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:26.373226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.413217 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4901ba8-a626-449e-ad3b-840707457c25 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.437929 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.464354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.465177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.465466 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.465752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.486969 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:26.503691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:26.504751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:26.505681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 281/548] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:26.532790 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.542706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0f3d-e3b6-4514-98e8-d3e61c733f9d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.586812 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.587576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.587869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.588158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.609804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.611341 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:26.642311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:26.644261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:26.646105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:26.646105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:26.646105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:26.646105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:26.646105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 268/549] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:26.650743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.730858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.746572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d07e-092a-4c21-929c-376cb852eaea None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.815220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.815915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.816207 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.816494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.817535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:26.817853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.819294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.838367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 282/550] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:26.838844 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fdbd-1755-47de-bc47-7376e86fabfb None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.844668 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.880478 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.881387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.881815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.882668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.886589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:26.886589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.886589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.906765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 269/551] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:26.908720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.959774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.159375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.165648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79617004-5f28-43d4-a66d-835989b160c2 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.232237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1958-46fd-4444-9716-0f58b53b5ef6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.276352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.282833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.282833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.282833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.302816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.306812 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:27.344362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:27.345475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:27.346550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:27.351160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 270/552] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:27.355772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.395593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.396434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.396730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.397018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.446130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.447678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-e1de3d14-d5d4-4942-bb5b-ddf79205e9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:27.499802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:27.500875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:27.502685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:27.502685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:27.502685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:27.502685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:27.502685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 283/553] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 657 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:27.508182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44026019-7c2a-484f-871b-3dac1989adfa None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.508483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44026019-7c2a-484f-871b-3dac1989adfa None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.508775 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44026019-7c2a-484f-871b-3dac1989adfa None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.510432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 284/554] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:27.511200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44026019-7c2a-484f-871b-3dac1989adfa None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.548522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d86e5-a146-4b08-adad-26ac155256c2 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.595210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.595900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.596193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.596478 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.597333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:27.597654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.599132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647962-393a-4981-847c-4b5577a1c648 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.620102 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 271/555] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:27.621492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.621794 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.622084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.627466 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.637293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44026019-7c2a-484f-871b-3dac1989adfa None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.641346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:27.642698 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:27.658867 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.682808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.683769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.684210 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.684694 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.685605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:27.686071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.688881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.706591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 285/556] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:27.707801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.734019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 272/557] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:27.735061 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.846127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afc67-3ea4-434d-9fea-6f8cd6958753 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.850424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7b0c-abcf-470e-afea-83b8ebad2607 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.884631 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.885583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.885940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.886304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] PATH_INFO: `/v3/users/swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.894429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.896257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.897136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.898520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.899032 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.899316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.910286 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.911788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:27.912373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:27.914891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:27.916083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 273/558] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:27.919640 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-c83fd7f8-1492-4cdd-a408-e7ae7ee6c1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:27.930007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:27.937869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 286/559] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07784a-2d6c-465b-b9b8-f283b174f206 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07784a-2d6c-465b-b9b8-f283b174f206 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07784a-2d6c-465b-b9b8-f283b174f206 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.942109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 287/560] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:27.945323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07784a-2d6c-465b-b9b8-f283b174f206 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.945777 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.947981 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.046944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ad30-e502-42fe-aa9c-90aeb252b42b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.054904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07784a-2d6c-465b-b9b8-f283b174f206 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.085025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.085834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.086123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.086408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.091819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.092506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.092797 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.093083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.093940 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:28.094267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.095761 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49e30-8ee1-4d6a-b905-f492d9588e37 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.098128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:28.105891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:28.107178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:28.108184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 274/561] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:28.108992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.114829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 288/562] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:28.115191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.115480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.115768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.138462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:28.139717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:28.181904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.203818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.213742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 289/563] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:28.214813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.231963 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3943db-bd8f-4f4f-875a-eb6d1968ee97 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.275263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.275857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.276188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.276430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.277332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:28.277537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.278978 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.296705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 275/564] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:28.296705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.338401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a2751-d49b-4a7b-a724-c55f58a74262 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.376554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.377247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.377533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.378113 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.378914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:28.379235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.380641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.390854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 290/565] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:28.390854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.406477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95095-052e-4f64-945f-23e0773232d8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.435128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.444530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.445728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.446020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.446309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.454339 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.498939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754146f-1cc7-43f3-bb31-fb30a842ae9a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.514496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.515983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.535167 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.535901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.536190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.536470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.547415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:28.555920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:28.557126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 291/566] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:28.558252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.622998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 276/567] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:28.623889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.651023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.669056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32497-6201-446f-abdf-e455e2cfc963 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.686968 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.705184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.705985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.706277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.706556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.713183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.714935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.722880 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd78f5d-046b-4cc0-a379-d7044d091940 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-969af970-91cc-4f27-bda7-1e1cbc2a607d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:28.729606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:28.730832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:28.732162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 292/568] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:28.734165 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394438-1235-4ba0-9d33-83267b96c718 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.734461 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394438-1235-4ba0-9d33-83267b96c718 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.734752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394438-1235-4ba0-9d33-83267b96c718 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.736101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 293/569] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:28.736798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394438-1235-4ba0-9d33-83267b96c718 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.758516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.759427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.759787 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.760069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.770133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.771913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:28.791858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:28.793011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:28.794201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:28.794201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:28.794201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:28.794201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:28.794201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 277/570] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:28.794201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.843132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394438-1235-4ba0-9d33-83267b96c718 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.874883 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.876994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.877695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.877985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.878269 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.879065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:28.879384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.880769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.888931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 294/571] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:28.889566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.900439 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551937c-2f02-4fd3-805b-978f88dfc9ea None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.932892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.935666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.936475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.936766 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.937046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.947362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.948852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3237fb69-abe2-43f5-8125-f3346b83d96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:28.967558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:28.968820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:28.969994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:28.969994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:28.969994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:28.969994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:28.969994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 278/572] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:28.970319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.970508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.970824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.986986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:28.988169 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:28.994390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d191d-e069-41a1-95e7-67e964ac6f32 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.028620 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.029295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.029586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.029870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.030667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.031026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.032484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.045185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 295/573] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.045803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.063224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 279/574] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:29.063224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.118172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.150695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.154394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bb89-96e7-4f9f-bd43-61331783ef79 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.156762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869cf16-9188-4a06-b174-6147505825e3 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.190469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.191180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.191469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.191751 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.191864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.192601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.192721 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.192919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.193035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.193210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.195044 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.204100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.205550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.206363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 296/575] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.207269 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:29.227988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:29.229212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:29.230438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:29.230438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:29.230438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:29.230438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:29.230438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 280/576] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:29.230438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.313672 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d190c78-a7f4-43cb-8bbb-8980b8b77067 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.332329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6442e1-70d8-4a97-9329-0b6c1ab80343 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.347333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.347483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.348054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.348347 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.348631 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.349393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.349710 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.351155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.362675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 297/577] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.363515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.367872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.368840 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.369130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.369412 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/8088e85aab0b4adcb6c53d99a531515c/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.384596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=8088e85aab0b4adcb6c53d99a531515c, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.385967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.399448 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 281/578] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:29 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/8088e85aab0b4adcb6c53d99a531515c/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:29.400240 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.485714 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a329c4b-0ee6-40dd-8585-74fd7f5ee194 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.524096 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7f134-1067-4ea6-bf94-4630970821c2 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.524594 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442254f-f264-4639-babc-5903db444e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.525419 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442254f-f264-4639-babc-5903db444e3c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.525709 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442254f-f264-4639-babc-5903db444e3c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.525993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442254f-f264-4639-babc-5903db444e3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.537890 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442254f-f264-4639-babc-5903db444e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-6442254f-f264-4639-babc-5903db444e3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:29.546142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:29.548056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 298/579] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:29.549013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442254f-f264-4639-babc-5903db444e3c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.573134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.573873 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.574164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.574447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.587931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.588757 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:29.606775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:29.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 282/580] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:29.609118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.640261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.652892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.676382 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442254f-f264-4639-babc-5903db444e3c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.710745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.711572 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.711868 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.712125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.712853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.713165 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.714851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.727041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 299/581] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.727972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.734082 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9b5a-f987-4a12-998b-dbf0dc554071 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.773353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.774148 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.774443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.774718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.781648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.783125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:29.796956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:29.798153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 283/582] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:29.799242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.840638 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89670-e8b3-4cd1-bd3e-a5cef56d71a3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.877524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.878198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.878482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.878753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.879535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.879847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.881247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.894575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 300/583] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.894575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.894575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.898132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.918427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca683ab8-29e2-43a2-af50-ac63f36c9e85 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.955114 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.955802 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.956089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.956373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.957222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.957537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.958991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.978120 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 284/584] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.979109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.012513 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ee6b-4a46-4bd3-a72d-362b20a2f8dd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.050768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.051948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.052239 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.052514 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] PATH_INFO: `/v3/users/glance` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.060745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.062215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:30.077067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:30.078139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 301/585] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:30.079245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.096500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80aa72-fe80-4b21-9ace-8356b2204427 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.135424 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.136427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.136919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.137470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.138590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.139140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.141009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.142940 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.162737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 285/586] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.164591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.170035 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.189043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af1c4c-80aa-4073-9e0b-10ac752b907e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.222846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.223647 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.223936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.224219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.235398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.236863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:30.255240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:30.256472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:30.257544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:30.257544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:30.257544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:30.257544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:30.257544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 302/587] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:30.257544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.295468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a79f7-27b9-4e9b-8461-b8e85ed0529a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.337460 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.338278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.338538 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.338837 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.351779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.353179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.362256 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bee89-cf78-4f55-9e61-e4b8551dc170 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:30.370368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:30.371385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:30.372381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:30.372381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:30.372381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:30.372381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:30.372381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 286/588] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:30.372381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.381222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.405952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.406739 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.407060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.407460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.408308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.408627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.410077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.427760 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.434944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 303/589] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.434944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.478802 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af67f70-b9aa-485d-aa7c-986fe3dbd26d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.512567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.513237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.513525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.513808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.514656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=25b9ae61f77548dbb5cf43fe320bec53) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.514999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.516474 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.523497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 287/590] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/role_assignments?user.id=25b9ae61f77548dbb5cf43fe320bec53&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.524377 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.554624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79487d0-7cf9-48a7-bc2c-175bb845d333 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.597886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.598592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.598910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.599266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.600070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.600392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.602654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.616052 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 304/591] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.617081 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.654300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.697086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719070-9db0-495a-9ea2-98b2b6f0e864 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.722031 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.751247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.751925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.752309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.752597 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.753336 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.753650 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.755139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.757819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ee9bd-4139-43c1-9057-e7395c1fdf18 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.772427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 288/592] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.800737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.801989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.802521 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.803221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.815226 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.817080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:30.840910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:30.841943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:30.843030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:30.843030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:30.843030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:30.843030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:30.849190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 305/593] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:30.849190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.886050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d7fa-007f-466a-8fd3-ec67d66859de None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.923212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.924030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.924315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.924596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.932931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.934372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:30.949943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:30.951086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:51:30.952139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:30.955957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 289/594] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:30.956813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.979157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.987779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143a16-e7b5-49e0-b0ed-a5424e868d1b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.002906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.034226 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.035073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.035365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.035650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.045742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.048150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:31.067726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:31.068801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:31.069871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 306/595] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:31.070437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.091812 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c9cd9-77ff-4124-ae3b-17c5f2b9f51e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.138443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.139068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.139363 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.139652 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.140396 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:31.140715 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.142278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.162994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 290/596] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.164899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.186870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d24e24-f636-4a38-a935-d1c00bc3875b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.224213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.225262 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.225824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.226351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.227542 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:31.228094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.229857 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.249701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 307/597] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.251057 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.254244 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.286065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.290958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00359a-b61a-4aba-a0c9-62a136579cfc None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.331115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.332284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.332815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.333322 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.334451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:31.335714 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.337420 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.352674 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 291/598] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.353977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.382597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68698e8f-557c-4459-9408-96653c0cb26d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.427284 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.428018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.428311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.428584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.437770 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.439745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:31.456372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:31.457472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:31.458494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:31.462211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 308/599] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:31.463578 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.476272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b4091-7339-4bf9-98dd-e39165fbe77a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.523250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.524245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.524534 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.524816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.537859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.538010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.539712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:31.562305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:31.563591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:31.564594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:31.564594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:31.564594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:31.564594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:31.564594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 292/600] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:31.564919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.580979 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.597121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f84c4-8a4d-4c1e-a037-d395146aa87d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.637579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.638961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.639473 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.640087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/047e7992883f471384163db5570ed52b/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.658682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=047e7992883f471384163db5570ed52b, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.660629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.677119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 309/601] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:31 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/047e7992883f471384163db5570ed52b/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:31.678770 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.689692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363da2a-22c3-4fd0-8074-40b40c0f7828 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.733615 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.734326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.734690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.735011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.735972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:31.736300 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.737802 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c54e-945c-40d5-94fa-67d3c0413119 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.759110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 293/602] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.760728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98cc41-6812-4fcb-8128-f5740296801d None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.761075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98cc41-6812-4fcb-8128-f5740296801d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.761403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98cc41-6812-4fcb-8128-f5740296801d None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.763032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 294/603] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:31.763610 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98cc41-6812-4fcb-8128-f5740296801d None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.830418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453374-7f72-4e46-936f-fe5b0a486fc6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.852784 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.863229 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.887917 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.888722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.889707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.890068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.891007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:31.891678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.893471 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cb566-1fcf-4d4d-96a4-e50147052d37 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.907808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 310/604] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.909247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.909555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.909840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.914472 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98cc41-6812-4fcb-8128-f5740296801d None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.931786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:31.933159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:31.962282 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.963366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.963773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.964392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/ac644ec1ab294fb7813be6036edfef7f/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.981209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=ac644ec1ab294fb7813be6036edfef7f, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.983023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.002541 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 295/605] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:31 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/ac644ec1ab294fb7813be6036edfef7f/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:32.003937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.026088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 311/606] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:32.088413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.202172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479990-1554-4e5c-96eb-d0973d972da3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.237942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.256130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0038d-3e2a-4db7-a250-6b7e52243372 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.259075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.259922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.260429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.260797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.261183 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.270370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.272033 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:32.287285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:32.288414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:32.289447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 296/607] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:32.295308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.332720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.333539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.334541 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.334855 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.358920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:32.367398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:32.368825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:32.369998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 312/608] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:32.380576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.486197 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11b47f-c2af-4b74-921d-686d8a1d3c4a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.552197 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.552886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.553173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.553457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.554918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:32.555239 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.556698 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.559915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ad6f-2840-46cb-99c7-2ddeacb1e2bb None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.590942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 297/609] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:32.593968 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.625798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.627519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.627675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.627965 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.628982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:32.629302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.633895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.651709 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 313/610] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:32.656799 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.684918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.691874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.761778 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94931d1-e82a-49f2-b764-ead29d3d0ef5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.810189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.811978 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.812451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.812911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/9858c1681f0e4afa9270642c5b22122f/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.831044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=9858c1681f0e4afa9270642c5b22122f, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.833290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.837817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e8aa-ec74-4e51-9c82-d71c54341046 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.873648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 298/611] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:32 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/9858c1681f0e4afa9270642c5b22122f/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:32.882629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.883525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.883815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.884099 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.897809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.899377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:32.919782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:32.920858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:32.921848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:32.921848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:32.921848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:32.921848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:32.921848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 314/612] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:32.927481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.075549 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.086636 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25a7f-f576-48fc-84c1-60303568d360 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.125793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.126473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.126764 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.127138 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.127877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:33.128245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.129748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e404-90a8-4c1d-94ea-301942b37227 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.142694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 299/613] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:33.148317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.194002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a744-465b-4aad-a149-d78803339508 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.194989 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a744-465b-4aad-a149-d78803339508 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.195291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a744-465b-4aad-a149-d78803339508 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.196679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 300/614] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:33.203200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.203495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.203779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.226720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:33.227940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:33.243114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.279871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083f91d-fcbc-4948-b297-dda228f93211 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.315271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.316149 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.316438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.316727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.325646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.327141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:33.342009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:33.343111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:33.344176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 315/615] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:33.349687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.364558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 301/616] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:33.404536 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.483506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9212-a3f2-4efe-88bc-19c1b08d3606 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.519322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.520061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.520354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.520637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.521498 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:33.521818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.523501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.541865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 316/617] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:33.542166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.547850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.563677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.603070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f187f-4e28-48d9-b744-9548a33426cc None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.659249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8524eeb-38db-4268-8e4e-ea5ef960da73 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.672894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.673729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.674019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.674306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.697597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.698266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.698475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:33.698674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.698909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:33.714781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:33.717189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:33.719226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 302/618] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:33.730827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.797075 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.814206 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.815717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.871774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9043-bc0d-4733-8f84-2dc8f119a082 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.908869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.909691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.909885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.910163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.910979 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:33.911298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.912833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.922425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 303/619] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:33.928402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.955167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.032121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 317/620] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:34.037280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.103703 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dea72-a330-42ae-82c2-cd83fc10fc71 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.142373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.143326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.143619 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.143906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.156686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.158258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:34.177870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:34.180265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:34.182832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:34.182832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:34.182832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:34.182832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:34.182832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 304/621] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:34.186201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.189180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.208786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc980b-ba2b-4296-9560-3ab18211cd5c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.257964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.310445 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c5f4c-c2c7-4ddc-a85c-0757692b8fce None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.321628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.322160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.322445 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.322726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.333406 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.335444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.353886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-a5a26dcc-5386-4dde-a02f-857506e080c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:34.354114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:34.355285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:34.356519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:34.356519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:34.356519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:34.356519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:34.356519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 318/622] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:34.357054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29846-b77f-42c8-bb97-645bd4518f17 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.357402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29846-b77f-42c8-bb97-645bd4518f17 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.357684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29846-b77f-42c8-bb97-645bd4518f17 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.358138 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.358582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.359048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.360032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:34.360502 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.362037 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fc45a-0ef4-4add-bb0b-add66d9e50b9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.363227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 319/623] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:34.363971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29846-b77f-42c8-bb97-645bd4518f17 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.378370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 305/624] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:34.385093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.385834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.386284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.411782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:34.413039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:34.490881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 306/625] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:34.492118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.517065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29846-b77f-42c8-bb97-645bd4518f17 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.568904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.570612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.570755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.571687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.572463 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.573368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:34.573816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.575516 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.592127 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 320/626] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:34.593205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.605089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.639625 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf82c6-1c28-4ef0-99d9-0897e7916fc2 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.680161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.681154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.681454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.681742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.691353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.693664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:34.711850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:34.712943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 307/627] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:34.714295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.732627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9fc5-9372-4f5f-9dbd-52d389f475c5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.769352 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee43f4-44f2-41bd-a186-b8fe19f62aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.770164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee43f4-44f2-41bd-a186-b8fe19f62aa1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.770453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee43f4-44f2-41bd-a186-b8fe19f62aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.771182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee43f4-44f2-41bd-a186-b8fe19f62aa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.784846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee43f4-44f2-41bd-a186-b8fe19f62aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-03ee43f4-44f2-41bd-a186-b8fe19f62aa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:34.793162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:34.794209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:34.795248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 321/628] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:34.796075 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82a4e-cd0f-4327-8fe8-9edcf7606e79 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.796830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82a4e-cd0f-4327-8fe8-9edcf7606e79 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.796830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82a4e-cd0f-4327-8fe8-9edcf7606e79 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.799157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 322/629] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:34.799157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82a4e-cd0f-4327-8fe8-9edcf7606e79 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.826416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f2f3-5eab-40b0-badb-441a17f54e61 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.829776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.868818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219718-8594-4da0-910b-f068673478bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.870094 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.870848 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219718-8594-4da0-910b-f068673478bf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.871145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219718-8594-4da0-910b-f068673478bf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.871973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219718-8594-4da0-910b-f068673478bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.879611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219718-8594-4da0-910b-f068673478bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.881075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219718-8594-4da0-910b-f068673478bf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-71219718-8594-4da0-910b-f068673478bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:34.896353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:34.897600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:34.898843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:34.902331 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 308/630] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:34.903059 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219718-8594-4da0-910b-f068673478bf None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.911411 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82a4e-cd0f-4327-8fe8-9edcf7606e79 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.947762 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.948442 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.948729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.949010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.949852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:34.950169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.951691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b159a-13e8-4881-9ef9-7d8c8519717a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.970037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 323/631] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:34.971595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.971892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.972173 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.988963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:34.990199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:35.029127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219718-8594-4da0-910b-f068673478bf None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.067857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.068861 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.069148 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.070123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.070922 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.071754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.077086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.087576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 324/632] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:35.087576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.092978 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 309/633] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.093943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.123769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.149397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.200668 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4def0-d954-43d3-8825-7e141cfeb304 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.204464 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855eaa-2717-4ac5-a423-e89596d6d13e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.240126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.240812 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.241140 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.241262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.241446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.242023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.242231 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.242352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.242547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.242659 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.245389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.254018 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.255490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.262877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 325/634] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.262877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:35.279560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:35.280809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:35.282028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:35.282028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:35.282028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:35.282028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:35.285441 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 310/635] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:35.286272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.371712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.371922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcec24-c26a-4c37-9aea-c74ce2e1f2d7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.393230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.407462 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1f01-f7da-4f67-a94a-ed0689943382 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.409189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.410707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.410707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.410707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.422139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.423714 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:35.442160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:35.443420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:35.445170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:35.445170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:35.445170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:35.445170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:35.445491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.446386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.446772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.447177 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.448692 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 326/636] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:35.449588 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.458023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:35.466872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:35.468134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:35.469297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:35.471238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 311/637] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:35.472072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.568138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1f0f-5594-4d58-bade-d010cec9d879 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.587210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a1e1-a3e9-4ab4-b0f3-dd4e282428e3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.604853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.605794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.606276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.606565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.607453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=8088e85aab0b4adcb6c53d99a531515c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.607780 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.609238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.626818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 327/638] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/role_assignments?user.id=8088e85aab0b4adcb6c53d99a531515c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.626818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.638279 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.639020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.639314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.639605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.640485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.640912 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.642386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.652347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.654417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.658813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 312/639] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.659926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.745216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4181e-e637-4732-a060-741fe627dc32 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.776014 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77139a7-098e-47e6-ba07-e4eee5244fb9 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.790772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.791613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.791935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.792533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.792972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.793290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.794720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.809432 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 328/640] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.810306 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.822302 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.823668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.823963 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.824247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.825020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.825332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.827256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f71f5-edd0-4ce5-9681-2d99ba271a4b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.836385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 313/641] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.838616 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323438-28b3-4062-9f5b-6d23df509741 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.839395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323438-28b3-4062-9f5b-6d23df509741 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.839687 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323438-28b3-4062-9f5b-6d23df509741 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.840964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 314/642] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:35.841739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323438-28b3-4062-9f5b-6d23df509741 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.910473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.926726 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.939028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5ea87-3a88-4af1-926c-ad11105c2da1 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.958804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323438-28b3-4062-9f5b-6d23df509741 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.977163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.978278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.978583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.978888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.986417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.987948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.995799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.996622 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.996904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.997190 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:36.002428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:36.003618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:36.004618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 329/643] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:36.008543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.009958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.011553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-6982696a-48e9-46f4-91a9-73088aad8812 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:36.028626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:36.030337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:51:36.031716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:36.034847 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 315/644] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:36.036111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.036412 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.036703 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.057593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:36.058974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:36.122077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e202f28-e951-4cf3-af9d-96d2be456cb5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.147317 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 316/645] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:36.147317 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.162995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.163876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.164234 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.164579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.176099 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.177670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:36.195735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:36.196988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:36.198202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:36.198202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:36.198202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:36.198202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:36.198202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 330/646] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:36.198694 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.204508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.205099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.260203 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55df4-2fe9-47a8-8be6-5b983f1e6c43 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.298238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.299341 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.299739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.300106 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.300920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:36.301245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.302694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.310449 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf985a7-0cc6-4d55-8a48-266e956e1a7a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.320450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 317/647] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:36.320450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.350275 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.351525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.351815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.352088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.353401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:36.353728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.355215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.374387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 331/648] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:36.375507 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.427625 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924c337-543e-4dff-b065-9eb50cdee996 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.439184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.439629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.466405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.467254 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.467550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.467838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.478096 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:36.485612 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f9213-2c44-440c-8f5a-5d58d0164cd8 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:36.485958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:36.487180 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 318/649] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:36.488136 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.529091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.530025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.530487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.530955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.531834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:36.532318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.533984 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.551221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 332/650] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:36.551221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.598138 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8381c-8aa4-441b-bcd1-32dd6da61723 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.634716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.635752 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.636049 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.636332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/25b9ae61f77548dbb5cf43fe320bec53/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.654498 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=25b9ae61f77548dbb5cf43fe320bec53, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.656209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.669029 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3bff-14f4-4783-acc8-2c1a4d840290 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.682900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 319/651] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:36 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/25b9ae61f77548dbb5cf43fe320bec53/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:36.682900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.692103 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.710990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.711788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.712199 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.712478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.717008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.801910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.804408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.835973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76527430-b2c4-4c3d-adec-52a829672da2 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.890572 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.891298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.891756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.892039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.893643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:36.893962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.895390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.905758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 320/652] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:36.906593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.933706 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 333/653] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:36.934938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.961200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.003372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.027461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8c16-578f-4aae-80dc-977d3237563e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.070201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ab6c6-559a-4f71-8fe7-da6310f2ca32 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.072069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.073129 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.073491 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.073847 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] PATH_INFO: `/v3/users/glance` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.089101 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.090956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.109629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:37.109855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:37.110853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:51:37.111952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:37.113881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.114401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.114954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.115523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 321/654] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:37.116406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.129569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.131691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:37.156603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:37.157635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:37.158610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:37.158610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:37.158610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:37.158610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:37.158610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 334/655] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:37.159389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.236518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.248150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b225d0-6bfb-415b-81e5-8e9a12dbd96a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.270837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9d43a-0fca-4cc6-af54-68fb90500044 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.283649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.284449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.284745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.285254 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.297007 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.298197 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.300095 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.314501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.315559 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.316091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:37.316205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:37.317145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:37.318228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:37.318228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:37.318228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:37.318228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:37.319283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.320430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.320971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.321976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 322/656] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:37.322815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.323109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.344120 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 335/657] 10.222.0.71 () {56 vars in 1137 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.345295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.428731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771afadf-cc8e-4302-b0ab-b5194790eb97 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.459145 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deda741-79a4-4cea-8896-3588a73712bb None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.465089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.465768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.466071 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.466336 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.467097 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.467411 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.468795 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.485632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 323/658] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.486617 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.494912 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.502324 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.503365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.503906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.504401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.505465 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.506073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.509144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.523093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 336/659] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.524538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.550212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.596017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738be7ef-3fd1-415a-94e3-3c91a6047957 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.631255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.632490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.632858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.633191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.643983 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750117f-730a-46b8-898d-cb48dcd769db None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.682237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269cf71-726e-417e-b954-65114896dddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.683682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269cf71-726e-417e-b954-65114896dddf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.684237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269cf71-726e-417e-b954-65114896dddf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.684765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269cf71-726e-417e-b954-65114896dddf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.693618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269cf71-726e-417e-b954-65114896dddf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.697125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269cf71-726e-417e-b954-65114896dddf None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.703043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.704509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-b269cf71-726e-417e-b954-65114896dddf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:37.715104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:37.716161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:51:37.717187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:37.719951 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 337/660] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:37.721046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269cf71-726e-417e-b954-65114896dddf None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.769732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.780687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.819713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 324/661] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:37.820734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.849087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269cf71-726e-417e-b954-65114896dddf None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.890491 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.891800 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.892423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.892918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.902323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.904319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:37.920795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:37.921815 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:37.922830 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:37.930431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b506-8388-4476-89cc-2c6a1923638c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.930843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 338/662] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:37.931923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.964361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.965030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.965316 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.965600 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.966450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.966767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.968239 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.986024 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 325/663] 10.222.0.71 () {56 vars in 1139 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.991802 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.008528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.060479 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6057-4d16-4a82-9b2d-7c54929741fe None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.073285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.098251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b369a0-5f77-47d0-8a01-ce9287a2b0c8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.100658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.101465 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.101749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.102028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.112494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.113949 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:38.133124 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:38.134133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:38.135566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:38.135566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:38.135566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:38.135566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:38.135836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.135836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.135836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.135836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.136163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:38.136163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.137133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904b46f-50b2-48c4-8b1c-a54e695f7a2c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.139037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 339/664] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:38.139997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.149937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 326/665] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:38.151446 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5da9-be95-409f-a396-0a2e6941f8b8 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.151886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5da9-be95-409f-a396-0a2e6941f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.152329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5da9-be95-409f-a396-0a2e6941f8b8 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.153983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 327/666] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:38.154875 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5da9-be95-409f-a396-0a2e6941f8b8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.230734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.252483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf91f6-3c23-421b-8051-15a3b36de6fd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.264165 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5da9-be95-409f-a396-0a2e6941f8b8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.291777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aee37-3f00-4cae-bac8-6cf924935324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.292467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aee37-3f00-4cae-bac8-6cf924935324 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.292764 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aee37-3f00-4cae-bac8-6cf924935324 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.293051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aee37-3f00-4cae-bac8-6cf924935324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.305357 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.306893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.307403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.307879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.309300 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:38.309826 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.311903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.324959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 328/667] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:38.325283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.325779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.369343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aee37-3f00-4cae-bac8-6cf924935324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.370840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aee37-3f00-4cae-bac8-6cf924935324 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.435297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348945ef-9c5e-46c6-a4c8-e1a74424369b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.467108 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.473268 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.474118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.474405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.474684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.480086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 340/668] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:38.480256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=047e7992883f471384163db5570ed52b) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:38.480256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.480407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.480407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.480407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.480633 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.484469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 329/669] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/role_assignments?user.id=047e7992883f471384163db5570ed52b&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:38.485185 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.504369 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:38.506315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:38.576000 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.594817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 341/670] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:38.594817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.640523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5342c5-b35f-4bd7-bdee-1876d46b0466 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.689812 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.690644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.690960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.691245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.699315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.700867 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:38.717010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:38.718063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:38.719915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 330/671] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:38.720466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.735887 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22a00-52c5-4270-8063-7015d25d5a7d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.787344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.788728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.789008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.789314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.793935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.801430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:38.803397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:38.823004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:38.824277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:38.825535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:38.825535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:38.825535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:38.825535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:38.827263 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 342/672] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:38.828232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.859388 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d1c02-b184-4fb3-b5bd-340de8d042df None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.888077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:38.910193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:38.911310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:38.912026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:38.912490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:38.928005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:38.938959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:38.940232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:38.941394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:38.945814 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 331/673] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:38.947115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:38.954186 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef00abd-a0c8-4ffd-82d9-14ef36e9b5ed None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:38.999021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.000448 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.000901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.001784 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.006107 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.007217 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.008957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.030691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 343/674] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.031787 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.071457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa779fe-4219-4c39-a14e-2ed3354646d4 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.089780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.116894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.117689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.117887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.118171 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.118966 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.119291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.120704 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e244-28be-44fc-b009-4530b236c4df None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.142258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 332/675] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.142258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c8448-a77a-4413-b621-0b7d874a9b8b None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.142258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c8448-a77a-4413-b621-0b7d874a9b8b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.142258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c8448-a77a-4413-b621-0b7d874a9b8b None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.143303 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 333/676] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:39.144492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c8448-a77a-4413-b621-0b7d874a9b8b None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.157881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733e18-e4ee-4236-b54b-6fd407fc587a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.163813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.199283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.199972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.200266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.200553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.201315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.201635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.203053 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.216530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 344/677] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.216530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.268587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c8448-a77a-4413-b621-0b7d874a9b8b None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.307902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.308607 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.308903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.309196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.310045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=ac644ec1ab294fb7813be6036edfef7f) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.310367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.311837 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db89dd-b145-42c2-a1ae-995caf4e7bc5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.325579 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 334/678] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/role_assignments?user.id=ac644ec1ab294fb7813be6036edfef7f&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.325832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959b41-5904-4fa4-9b07-f7bea8c25e0c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.326276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.326276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.326276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.340560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:39.341720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:39.366358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.367208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.367495 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.367776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.375421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.376933 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.390404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:39.393430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:39.394538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 345/679] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:39.395567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.426646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.451482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 335/680] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:39.452830 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.545587 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f95ffd-4a01-4a2f-a23e-7e776ca24b03 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.579686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5178-34a9-4984-a817-71edf9be9382 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.586603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.587465 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.588180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.588473 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.602814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.604513 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:39.625994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:39.627046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:39.628050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:39.628050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:39.628050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:39.628050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:39.628050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 346/681] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:39.628400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.639014 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.640128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.640431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.640714 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.641514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.641825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.643973 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.659370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 336/682] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.660046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.699176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.726746 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.752508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d162-1b26-44db-a27f-4d99a491a078 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.783575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6aa14-3a61-40e8-ab88-63975450ed6b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.788776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.789670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.790030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.790389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.801939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:39.810701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:39.811774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:39.812713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 347/683] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:39.814227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.827474 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.828262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.828558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.828838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.829578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.829895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.831433 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.845225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 337/684] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.846065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.936101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c863-7f26-4ae5-8c67-5dfa803f5d59 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.945737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.955689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f22ff-f891-42ce-adcf-3c89b0648c0b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:39.980240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.981317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.981997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.982452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.983510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=9858c1681f0e4afa9270642c5b22122f) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.984012 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.985775 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:39.993973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 348/685] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/role_assignments?user.id=9858c1681f0e4afa9270642c5b22122f&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:39.994874 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:39.995298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:39.995728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:39.996119 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:39.996523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:39.997403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:39.997825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:39.998998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:39.999872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.009658 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 338/686] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:40.015064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.126549 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df216c-7751-49b9-9f85-6001517e843e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.169214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.170354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.170843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.171306 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.180654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.182466 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:40.198959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:40.200285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:40.201683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:40.204194 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 349/687] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:51:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:40.210487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.257512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb000b-43f8-400a-a84c-7b1335021234 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.283141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.296617 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.297215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.297603 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.298032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.310736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.312385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:40.332294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:40.333490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:40.334528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:40.334528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:40.334528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:40.334528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:40.334816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 339/688] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:40.336603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00463656-68a4-4492-9a4a-563c3a3bc4f4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.340979 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.344658 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.379648 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.380596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.381087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.382095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.383138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:40.383615 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.385345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.405211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 350/689] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:40.411043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.451358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3a011-1027-4500-acd0-9b72d55e00e1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.490172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.491550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.491911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.492267 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.493163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:40.493559 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.495128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.508221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 340/690] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:40.513563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.534119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f3e6-b563-498d-aed7-2d038688d3b6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.558966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.576496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.577602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.578201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.578675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.581533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.624878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab1774-6d56-4dd1-91f2-45b13f2bb628 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.658499 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.659974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.660524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.661008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.661401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.661795 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.672238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.673486 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:40.689306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:40.690508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:40.691613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 341/691] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:40.697331 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.790050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 351/692] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:40.795891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.819868 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.825205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b74d4-48ac-4749-af16-cd49a6f2af32 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.850989 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.862759 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.863769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.864533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.864836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.866451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:40.866928 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.868497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.887935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 342/693] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:40.893332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.916049 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e251-316f-49dd-a676-00096f8c6b0a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.958535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.960346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.960817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.961565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.976433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.978332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8ca22d62-add3-4a04-a2c0-dbd5691b6298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:41.001994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:41.003358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:41.004585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:41.004585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:41.004585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:41.004585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:41.008166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 352/694] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:41.013077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7acdb-068a-4f86-a826-4e7dd7c9a60c None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.013077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7acdb-068a-4f86-a826-4e7dd7c9a60c None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.013077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7acdb-068a-4f86-a826-4e7dd7c9a60c None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.017116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 353/695] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:41.017116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7acdb-068a-4f86-a826-4e7dd7c9a60c None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.029842 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba977-e349-4d87-98cc-5b14dd9e1b0c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.066060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.066938 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.067241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.067528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.125784 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.140743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.162037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7acdb-068a-4f86-a826-4e7dd7c9a60c None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.171430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.173139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.199577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db3645-d528-495a-9972-c326567b777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.200654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db3645-d528-495a-9972-c326567b777b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.201138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db3645-d528-495a-9972-c326567b777b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.201629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db3645-d528-495a-9972-c326567b777b None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.202761 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db3645-d528-495a-9972-c326567b777b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:41.203405 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db3645-d528-495a-9972-c326567b777b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.205084 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db3645-d528-495a-9972-c326567b777b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.223342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 354/696] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:41.225083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.225576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.226089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.245492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:41.247365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:41.285758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 343/697] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:41.286713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.343192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 355/698] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:41.344677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.379927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.401109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3b92e-f5c8-4f0e-a98e-8892dcea0c21 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.414858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.441726 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.442979 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.443632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.445316 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.453493 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.455272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.461151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb095a70-36cc-4b64-bd2f-220c0e4908c3 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:41.471222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:41.472358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:41.473370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:41.477982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 344/699] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:41.478852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.498647 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.499609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.499964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.500245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.512015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.513526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.596569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0dadf-4188-46ef-a05b-608e6b954f88 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.635276 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.636152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.636443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.636792 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.637477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.638888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:41.656150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:41.658628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:41.660886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 345/700] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:41.663940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:41.664095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:41.672141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:41.674048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:41.674048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:41.674048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:41.674048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:41.674048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 356/701] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:41.674048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.674510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.776007 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6f5f0-bc1c-4a93-aa69-f2787f5c2263 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.780374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71945f-5c76-46da-b407-fafedbec5783 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.795909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.818328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.819997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.820729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.821029 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.821309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.821598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.822017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:41.822335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.822722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.823256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.823787 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.824518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:41.825100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.826885 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.828910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 357/702] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:41.829725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.846560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 346/703] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:41.848062 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.923788 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.945183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ab0c-f10c-4d39-bf2c-2e49b751d71f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.963485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee522e-d67a-4705-82a3-7db8d4194b0e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.986730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.987486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.987774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.988056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.988817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:41.989134 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.990584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.014614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 358/704] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.014614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.017172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.018105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.018605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.019127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.020395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.020954 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.022810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.030679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 347/705] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.031947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.058379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.133834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2904ad-0d3d-4be8-b4cb-1baae8e0a75b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.145271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b50358-6ed0-4c20-8ed5-e7138d12c776 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.174419 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.175332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.175584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.175874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.176782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=8088e85aab0b4adcb6c53d99a531515c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.177041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.179475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.179705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770cd3b-df70-4068-86c5-34c81296ea5d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.186428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.194820 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 359/706] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/role_assignments?user.id=8088e85aab0b4adcb6c53d99a531515c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.196318 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.196832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.197347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.205887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.207807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:42.238821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:42.239917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:42.240933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:42.243786 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 348/707] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:42.249680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7b2df-d182-4e0f-bf38-30b390b74fc7 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.249868 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.249996 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7b2df-d182-4e0f-bf38-30b390b74fc7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.250250 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7b2df-d182-4e0f-bf38-30b390b74fc7 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.251805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 360/708] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:42.269446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.269740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.270032 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.302889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:42.305166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:42.390244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c694099-efac-4654-88d7-a4685bedb3d6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.418814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 361/709] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:42.441818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.461109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.461966 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.462360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.462769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.463980 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.464401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.466554 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.477119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.495113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 349/710] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:42.508280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.565835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750f3d-2607-4747-ac48-f443a2b5fb18 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.611464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.612285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.612576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.612865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.619113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.630387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.632488 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:42.652519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:42.653543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:42.654776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:42.654776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:42.654776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:42.654776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:42.654776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 362/711] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:42.661894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.743083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894a3bb-e25f-4266-8771-a8e8507fdc37 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.810822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.815849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.816351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.822076 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.823107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=25b9ae61f77548dbb5cf43fe320bec53) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.823440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.824947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.839585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 350/712] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/role_assignments?user.id=25b9ae61f77548dbb5cf43fe320bec53&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.855002 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.874097 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ac665-6169-49a0-a8d3-f5bd5e43e8ed None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.919415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.920019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.920310 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.920596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.921346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.921658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.923097 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d017f-47ab-4546-8c25-ca62f28a1259 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.936562 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 363/713] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:42.944525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.091558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8488d-d92b-404b-bd64-0e3e9bfbcc88 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.106104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.129227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.129976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.130271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.130617 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.131986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.133447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.135689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879841-29dd-43c8-8fbc-5c17953743bb None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.135980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879841-29dd-43c8-8fbc-5c17953743bb None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.136261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879841-29dd-43c8-8fbc-5c17953743bb None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.137790 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 364/714] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:43.143242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.143763 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.144260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.166837 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 351/715] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:51:42 2022] POST /identity/v3/users => generated 254 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:43.169407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:43.171099 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:43.254407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 365/716] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:43.278565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.395558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066220c-886b-453b-8f4f-6be8d208c972 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.434324 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.435558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.436079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.436587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] PATH_INFO: `/v3/services/network` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.437458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.439087 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:43.452193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:43.453513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:43.454638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:43.457149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 352/717] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:43.463241 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.566936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.593645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482433c-a1b7-46ef-938c-c2cab08a32db None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.630603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.631506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.631905 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.632292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.633130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] RBAC: Adding query filter params (name=network) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:43.633555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.635101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0455f30-e5c6-4737-8a7f-4d7f33f8dee9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.640320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 366/718] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:43.645953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.690025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.773837 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb954534-6698-4ab7-ad78-5e3e5d120ffe None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.814954 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.815917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.816455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.816888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.817772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] RBAC: Adding query filter params (type=network) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:43.818237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.819919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefadf5-9fc5-4f71-8a88-f5e9ca915059 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.825117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 353/719] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:44.759390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b527c9-e436-416c-ab47-6b7d5c9748a7 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.759968 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b527c9-e436-416c-ab47-6b7d5c9748a7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.759968 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b527c9-e436-416c-ab47-6b7d5c9748a7 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.761605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 367/720] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:44.766937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52803054-9e7d-4de8-be5d-2c1d80ea4a27 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.767481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52803054-9e7d-4de8-be5d-2c1d80ea4a27 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.767481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52803054-9e7d-4de8-be5d-2c1d80ea4a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.792050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-52803054-9e7d-4de8-be5d-2c1d80ea4a27 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:44.793284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-52803054-9e7d-4de8-be5d-2c1d80ea4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:44.885397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 354/721] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:44.924530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b527c9-e436-416c-ab47-6b7d5c9748a7 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.988734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416c67-82de-4ac1-b57d-8e1b3ae26edd None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.989103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416c67-82de-4ac1-b57d-8e1b3ae26edd None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.989325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416c67-82de-4ac1-b57d-8e1b3ae26edd None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.991547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 355/722] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:44.997392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.997900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.998037 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.034833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:45.034833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:45.084585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:45.119413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b527c9-e436-416c-ab47-6b7d5c9748a7 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:45.159643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 356/723] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:45.182534 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.191643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:45.192699 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.193222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.194260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.199440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:45.201153 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:45.227974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:45.239076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 368/724] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:51:44 2022] POST /identity/v3/services => generated 251 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:45.296444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0428e5b-0509-4f1c-8ade-d8a41b73383f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:45.356252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:45.357509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.358029 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.358525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.376477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:45.385201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:45.386234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:45.391999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:45.395385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 357/725] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:45.401211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.529839 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf16c-ebe4-43e1-9345-407ba8f584a4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:45.565538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:45.566147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.566738 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.567056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.567824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:45.568141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:45.569564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:45.578626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 369/726] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:45.584010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.602949 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:45.705793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc73940-5b8e-4fa8-b2e4-13c065422785 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:45.755509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:45.756357 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.756648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.756930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.772872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:45.774341 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:45.801011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:45.802045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:45.803159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:45.803159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:45.803159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:45.803159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:45.805649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 358/727] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:45.811554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.908067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:45.959191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb35c79-8dd4-41b0-bf4b-2f36838c5a00 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.009684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.010832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.011336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.011850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.012825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:46.013368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.015085 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec00a4e-f89d-4c23-ac3b-162628ddd658 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.041877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 370/728] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:46.047791 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.137468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.192561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e91e93-d0c2-4d12-b0ad-a4abd11e23a2 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.220455 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ca2f-e6c3-4f16-a784-8cedb08a0b71 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.221090 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ca2f-e6c3-4f16-a784-8cedb08a0b71 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.221602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ca2f-e6c3-4f16-a784-8cedb08a0b71 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.223302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 371/729] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:46.236348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab62132-f44e-47b5-b635-f9263498ef98 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.237015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab62132-f44e-47b5-b635-f9263498ef98 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.237586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab62132-f44e-47b5-b635-f9263498ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.239874 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.240715 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.241007 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.241291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.250907 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.252361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:46.268011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:46.269079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:46.270782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 359/730] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:46.273190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-dab62132-f44e-47b5-b635-f9263498ef98 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:46.278809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.279571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-dab62132-f44e-47b5-b635-f9263498ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:46.382896 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 372/731] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:46.386813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01fd1-adf0-4354-8275-87cd19682d36 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.386813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01fd1-adf0-4354-8275-87cd19682d36 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.386813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01fd1-adf0-4354-8275-87cd19682d36 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.387834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 373/732] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:46.391946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.392234 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.392516 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.405840 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a662733-d496-4dbd-8fc0-7c5b17ea0d60 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.418635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:46.419856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:46.444831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.457860 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.460376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.460919 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.461415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.462485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:46.463052 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.465516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.476038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.491970 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 360/733] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:46.493233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.503990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 374/734] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:46.504956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.628093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16f392-2f91-4d2a-bf98-acfdbcfbc68c None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.632646 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7039-54b7-48a2-b0bf-98c768866f91 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.666988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88330-e867-489f-8bf7-439de236888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.667791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88330-e867-489f-8bf7-439de236888d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.668076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88330-e867-489f-8bf7-439de236888d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.668356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88330-e867-489f-8bf7-439de236888d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.679341 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.679526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c88330-e867-489f-8bf7-439de236888d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.680569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.680979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c88330-e867-489f-8bf7-439de236888d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.681344 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.681727 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.694203 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-33c88330-e867-489f-8bf7-439de236888d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:46.701311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:46.702470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:46.703708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:46.703708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:46.703708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:46.703708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:46.704663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:46.705834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:46.706981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:46.713678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 375/736] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:46.714029 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 361/736] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:46.715365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88330-e867-489f-8bf7-439de236888d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.715807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.757300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.766663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.831775 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88330-e867-489f-8bf7-439de236888d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.841942 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00667c1-b1dd-48e7-ae39-f1600ad2833b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.869195 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f263-e0de-48e5-80c2-2343cad8c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.870115 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f263-e0de-48e5-80c2-2343cad8c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.870607 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f263-e0de-48e5-80c2-2343cad8c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.870882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f263-e0de-48e5-80c2-2343cad8c2e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.878002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.878686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.879009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.879299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.880069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:46.880388 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.882342 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.883265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655f263-e0de-48e5-80c2-2343cad8c2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:46.890694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 362/737] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:46.891524 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-c655f263-e0de-48e5-80c2-2343cad8c2e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:46.892025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:46.893066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:46.894003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:46.898246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 376/738] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:46.899636 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b45c6-f6a6-4f88-a466-6765e4cb0b86 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.899929 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b45c6-f6a6-4f88-a466-6765e4cb0b86 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.900212 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b45c6-f6a6-4f88-a466-6765e4cb0b86 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.905573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 377/739] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:46.905573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b45c6-f6a6-4f88-a466-6765e4cb0b86 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.999283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.006050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887f6c7-8068-4427-9a28-5db65c4ca5d6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.017867 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b45c6-f6a6-4f88-a466-6765e4cb0b86 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.018589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.049546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.050225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.050577 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.050835 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.051563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:47.051879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.053255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.054110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.055125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.055417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.055976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.070275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 363/740] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:47.070461 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.070551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.070644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-e4719172-409c-47b9-81f8-c5eee376b4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:47.089342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:47.090494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:47.091741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:47.091741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:47.091741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:47.091741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:47.097139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 378/741] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:47.097139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.097139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.097139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.112412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:47.113599 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:47.184066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 379/742] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:47.184702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.193066 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cad78-4155-4197-a11c-0018a975c505 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.242117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.243453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.244386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.245149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.246387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:47.247336 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.249525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.264408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 364/743] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:47.264408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.264678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.293272 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d17b1-7a03-40eb-afc5-dcf4ca3b5bd2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.294284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.330870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.331716 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.332006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.332289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.339798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.341263 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:47.355740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:47.356734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 380/744] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:47.357728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.383835 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b81bf9-59bb-4d20-acf5-3bb1b887219a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.421254 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.421936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.422227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.422512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.423281 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:47.423603 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.424985 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.442529 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 365/745] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:47.442529 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.466693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece31d9-f252-4656-9da7-1d74103ed9ea None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.502460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.503085 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.503374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.503671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.504383 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.505755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.507970 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.522393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 381/746] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:51:47 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:47.523771 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.536443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.552178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3d1a-ac81-41ea-bdc6-dd6901c99ee1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.603841 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.604688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.604968 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.605265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.617152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.618640 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:47.639668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:47.640926 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:47.642307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:47.642307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:47.642307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:47.642307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:47.645949 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 366/747] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:47.647447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.666685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd3003-4832-404a-9805-367a0246ef66 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.713098 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.714051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.714343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.714628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.715492 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:47.715811 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.717304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.737151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 382/748] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:47.738176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.780335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb04d62-d6c8-4240-9794-d5bff5a742f8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.805567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.827745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.828575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.829648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.829953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.833079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.841070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.843096 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:47.862043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:47.863384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:51:47.864525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:47.867400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 367/749] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:47.872563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.872719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876f5e-6d5b-4c54-8200-215addb17e12 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.918417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.919698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.919993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.920278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.921072 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:47.921391 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.923366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.937643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 383/750] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:47.938545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.987535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba26dd-bdf0-40c9-9aca-2671790e00d5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.026355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ddede-608b-4f2d-8889-2ab80fe69c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.027413 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ddede-608b-4f2d-8889-2ab80fe69c34 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.027733 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ddede-608b-4f2d-8889-2ab80fe69c34 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.027991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ddede-608b-4f2d-8889-2ab80fe69c34 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/8088e85aab0b4adcb6c53d99a531515c/roles/40636a8261d645b6a2041281c7044370` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.030036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ddede-608b-4f2d-8889-2ab80fe69c34 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=8088e85aab0b4adcb6c53d99a531515c, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.031578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ddede-608b-4f2d-8889-2ab80fe69c34 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.046378 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 368/751] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:47 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/8088e85aab0b4adcb6c53d99a531515c/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:48.048045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f082b-688b-4ddb-a276-fe296675267c None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.048405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f082b-688b-4ddb-a276-fe296675267c None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.048765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f082b-688b-4ddb-a276-fe296675267c None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.050353 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 369/752] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:48.051039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f082b-688b-4ddb-a276-fe296675267c None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.062409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fcc18-15b9-4520-891e-d16953121f22 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.081733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.107717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.108777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.109407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.109903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.111115 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:48.111725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.113639 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf54e-3dcb-49f9-bd6a-d12a31b57afc None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.136068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 384/753] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.137891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.138400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.138957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.158167 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:48.159503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:48.179208 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.205186 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f082b-688b-4ddb-a276-fe296675267c None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.235522 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 385/754] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:48.236468 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.247866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.248689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.248969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.249262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.259012 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.260839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:48.278211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:48.279458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 370/755] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:48.280551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.382601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c49a84-b5d1-42e3-a9c0-a8f088974218 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.384246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.414616 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b908b-ba8b-48d7-9cb8-49cb24879396 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.420566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.421363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.421749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.422129 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.436143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.462672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.464086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.464567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.465030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.465864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.467450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:48.483790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:48.485123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:48.486285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:48.488619 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 371/756] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:48.491283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.509514 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.512045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.599089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca10a6-7aa8-49bc-bd62-3b791498546b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.637505 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.638116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.638411 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.638693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.639581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:48.639897 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.641473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.654145 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 386/757] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:51:48.655376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.658921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.665219 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 372/758] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.666154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.713150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.785488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85b57-be0f-412d-90ae-8200a70aa527 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.801903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dfb8-3aec-44c0-9973-9407c95732d4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.831612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.833100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.833612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.835008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.846917 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.847591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.847877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.848155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.849114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:48.849245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.850632 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.851897 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.854624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.856418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 387/759] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.857295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:48.874544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:48.876099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:48.877227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:48.877227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:48.877227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:48.877227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:48.877227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 373/760] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:48.877227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.931137 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.971769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ff52-cc4e-4cf1-8328-3b2e052294d8 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.989712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.001146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b789f-711b-478e-b7ad-32bee5673818 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.019674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.020356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.020647 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.020930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.041752 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.042760 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.043309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.043817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.044868 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:49.045379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.047102 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.053501 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 374/761] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:49.054629 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.093172 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.094604 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.160108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.165169 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57c6f6-3728-444a-b537-bcd335c202a6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.197738 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 388/762] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:51:49.198508 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.204699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.205659 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.206290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.206843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.207800 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:49.208513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.210340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.232264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 375/763] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:49.233320 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.252361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.313663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95efc9-efae-4860-8ad3-9d664d440514 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.352300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.353231 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.353710 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.354213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.355343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] RBAC: Adding query filter params (interface=public, service_id=0febffb6762940778d425e813de5acd5, region_id=RegionOne) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:49.355672 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.357064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.368720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 389/764] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/endpoints?service_id=0febffb6762940778d425e813de5acd5&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:49.370980 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291455c-c950-4113-9594-4581ecb38178 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.373532 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.408925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.420810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.422237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.422696 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.423020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.438643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.440422 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:49.465090 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:49.466109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:49.467159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:49.467159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:49.467159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:49.467159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:49.467159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 376/765] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:49.467159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.493911 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dc7b0-2c17-4877-80ac-35658054dbd5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.530425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.531662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.532146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.532631 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.540509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.542203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.554123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:49.558087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:49.559150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:49.560126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:49.562398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 390/766] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:49.563418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.597585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7f26-b46b-40e3-84d4-fc2ab0de9125 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.636191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.637201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.637699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.638176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.639123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.640702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.647644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 377/767] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:49.648641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.725467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.748125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351755af-5381-4344-8758-e4652b2227c4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.806723 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.807843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.808215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.808567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.809388 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:49.809776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.811582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.826989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 391/768] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:49.832698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.901073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afdaae-ab99-4c45-9d96-ef05ee22319b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.939019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.947282 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.948382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.949056 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.949413 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.950325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:49.950960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:49.952473 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3c74e-71e7-431c-a512-9e052190dd41 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:49.966138 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 378/769] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:49.971425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df326-c40f-4569-b619-986fb62d6529 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.971722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df326-c40f-4569-b619-986fb62d6529 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.972007 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df326-c40f-4569-b619-986fb62d6529 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.973154 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa594cb-e85b-42ca-9d19-bdaf45cd58ad None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.973613 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 379/770] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:49.975362 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df326-c40f-4569-b619-986fb62d6529 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.035721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.037517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.038110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.038632 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.048914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.051943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-26592e32-4564-455f-931d-27995d0df9fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:50.073829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:50.074921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:50.075946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:50.076423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 392/771] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:50.077914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.078211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.078553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.096352 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:50.097567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:50.101456 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.109195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df326-c40f-4569-b619-986fb62d6529 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.158836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.160031 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.160731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.161174 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.162929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=d325ab6bbdd44fc89bb94922488edd2c) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:50.163415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.165878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.178950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 380/773] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/role_assignments?user.id=d325ab6bbdd44fc89bb94922488edd2c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.179184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 393/773] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:50.180276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.223088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.347695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.382284 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23def47-a235-4a93-9ff9-7bcc5be47eca None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.437053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53c65-b920-49fa-9b36-a0fd31ec63ea None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.445545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.447801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.448376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.448849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.449852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:50.450417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.452128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0878-abf3-4337-92f7-e07a1098d41a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.468760 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.472435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 394/774] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.473744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d700ef-ee6d-4427-b153-6fc7e5219be2 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.474036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d700ef-ee6d-4427-b153-6fc7e5219be2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.474320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d700ef-ee6d-4427-b153-6fc7e5219be2 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.476470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 395/775] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:50.483069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.483934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.484062 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d700ef-ee6d-4427-b153-6fc7e5219be2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.484224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.484506 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] PATH_INFO: `/v3/services/network` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.485182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.486561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-1c4447c7-3404-466e-8ba5-063695883801 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:50.502550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:50.503965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:50.504917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 381/776] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:50.505856 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.505856 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.506405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.527118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:50.528232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:50.615496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d700ef-ee6d-4427-b153-6fc7e5219be2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.619137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 382/777] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:50.620089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.660252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.660930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.661225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.661573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.663079 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=25b9ae61f77548dbb5cf43fe320bec53) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:50.663399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.665142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.676474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 396/778] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/role_assignments?user.id=25b9ae61f77548dbb5cf43fe320bec53&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.677624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.714618 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.759159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.809246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe1f98-8ede-42b5-883e-947fdcdbc198 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.812706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b42334-1fe3-4bbd-85ea-1f10c070d0a8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.849208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.850930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.851390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.851840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.864721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:50.873358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:50.874640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:50.875776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:50.878339 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 397/779] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:50.885610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.908155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.909522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.910566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.913050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.914033 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] RBAC: Adding query filter params (name=network) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:50.914511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.916390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.930879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 383/780] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.933340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.051908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5635730-2802-4e6c-8db8-6d1030d4b05e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.080050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.094543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.095259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.095545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.095824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.097047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.097372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.099110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.110150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2b7c-af88-4128-a158-fc8ee5ddae89 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.110363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 398/781] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.123926 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.133472 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.157740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f899-9055-4733-97ee-98496869bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.158958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f899-9055-4733-97ee-98496869bdce None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.159640 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f899-9055-4733-97ee-98496869bdce None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.160153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f899-9055-4733-97ee-98496869bdce None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.161137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490f899-9055-4733-97ee-98496869bdce None admin] RBAC: Adding query filter params (type=network) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.161673 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490f899-9055-4733-97ee-98496869bdce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.163485 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490f899-9055-4733-97ee-98496869bdce None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.169921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 384/782] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.175982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f899-9055-4733-97ee-98496869bdce None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.260382 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fbf98-0612-40ad-b413-118533a81e26 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.289923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f899-9055-4733-97ee-98496869bdce None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.295290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.296096 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.296372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.296648 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.308744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.310330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:51.329069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:51.330114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:51.331148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:51.331148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:51.331148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:51.331148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:51.332300 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.333274 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.333783 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.334622 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.334959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 399/783] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:51.335905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] RBAC: Adding query filter params (interface=public, service_id=4ecd4454a84c4137aebe4a90cb0fc4c7, region_id=RegionOne) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.336206 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.336799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.338653 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.347792 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 385/784] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/endpoints?service_id=4ecd4454a84c4137aebe4a90cb0fc4c7&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.353488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.381903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.418832 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.443482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e6d98-dcc0-4544-8d7c-322ce41d0580 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.479328 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.480008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.480302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.480700 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.481450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.481767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.483315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.500778 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 400/785] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.502045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.531946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284de3-9dfd-4855-8343-dc8affdb1e1f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.596437 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.597127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.597423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.597716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.598415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.599854 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.603202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.607503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40f444-67eb-4097-ae3a-3716a5549ebb None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.613476 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 386/786] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.647145 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.647995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.648286 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.648566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.656581 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.658081 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:51.674337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:51.675515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:51:51.676571 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:51.680907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 401/787] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:51.683920 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.858726 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0109e2a-7dd2-4f01-9ebb-5952bb26957e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.861249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.899706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.900319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.900612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.900902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.901769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.902093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.903581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cf364-9414-451a-9b38-1b9765ef49b0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.934880 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 387/788] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.940394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.121650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536193d0-92ba-47b9-94fc-f6a146e11c49 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.169256 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.169850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.170140 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.170423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.208575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.221629 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b744b-329e-49f8-887c-452e4934ef0a None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.222977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b744b-329e-49f8-887c-452e4934ef0a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.222977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b744b-329e-49f8-887c-452e4934ef0a None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.223886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 388/789] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:52.230184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.230480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.230771 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.259838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:52.261168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:52.269844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.272219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.376937 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 402/790] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:51:52.382540 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.434499 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 389/791] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:52.467190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.468543 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.555260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b097-daaf-49d3-88b4-2e8b79aea33d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.625295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.626484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.627827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.630305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.642019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.643176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.644464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.650771 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e257a0-0e5c-4da6-b0d3-aad431a4b423 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:52.664752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:52.665810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:52.666856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:52.666856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:52.666856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:52.666856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:52.669198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 403/792] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:52.680089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.747603 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.748356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.748700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.748981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.749705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.751172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:52.773892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:52.775299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:51:52.776278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:52.784391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 390/793] 10.222.0.71 () {56 vars in 1129 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:52.794644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.800105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040c79f-6ef8-4f86-8fc3-11fd323038e0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.827233 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.840322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.841494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.841998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.842509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.843663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:52.844192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.846159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.860567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 404/794] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:52.867592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.986360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a9c9-feb4-48cb-816a-e156f8804329 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.067018 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f02863-fc7b-442b-94af-9567e1f65915 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.108146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.108843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.109132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.109413 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.110140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.110450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.111863 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.114371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.115248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.115532 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.115810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.123420 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 391/795] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:53.124900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.126369 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.131417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:53.144447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:53.145484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:53.147215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:53.149807 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 405/796] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:53.158921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.178434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.218681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.284675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f808-49f9-489a-98d9-b29fffb57d08 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.296334 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a007a3-f321-4ecd-89ae-7c8afcf4e3f7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.325371 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.326056 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.326454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.326744 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.327645 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.327964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.329387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c3a5-bf73-4e5d-9170-85daf8fb2a76 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.335828 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 392/797] 10.222.0.71 () {56 vars in 1124 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:53.337347 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.337513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049c35-07fe-46ec-98c6-1717858bbd41 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.337668 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049c35-07fe-46ec-98c6-1717858bbd41 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.337939 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049c35-07fe-46ec-98c6-1717858bbd41 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.338520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.338941 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.339330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.339748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 393/798] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:53.343060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049c35-07fe-46ec-98c6-1717858bbd41 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.344380 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.344793 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.346541 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092d6c3-89b2-49ca-80af-f472858b3962 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.362703 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 406/799] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:53.364122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.364420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.364712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.383383 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:53.384915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:53.444100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.462573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049c35-07fe-46ec-98c6-1717858bbd41 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.464006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 407/800] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:53.465130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.488376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.500164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.500929 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.501319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.501701 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.502562 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.504691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.533489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 394/801] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:51:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:53.535057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.594929 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64917fb8-15f3-4de1-88bc-aeeed53591d6 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.642601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.643697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.643697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.643907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.644712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=8088e85aab0b4adcb6c53d99a531515c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.645034 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.646567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4cfcc-7045-46ab-9abb-113f5c9faa5a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.658960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 408/802] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/role_assignments?user.id=8088e85aab0b4adcb6c53d99a531515c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:53.660581 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94c85-a3a1-4dd7-bfca-4def8624ac56 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.660874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94c85-a3a1-4dd7-bfca-4def8624ac56 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.661167 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94c85-a3a1-4dd7-bfca-4def8624ac56 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.664037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 409/803] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:53.668472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.668802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.669046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.670931 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd508692-faad-4241-a3f1-c3c06089919d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.704052 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:53.705323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:53.716687 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.718050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.718606 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.719147 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.729713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.735374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:53.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:53.746423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:53.747470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:53.750489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 395/804] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:53.757531 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.819807 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 410/805] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:53.858932 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.872568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.893770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141cd7-469b-4f65-9d3b-196f94484a73 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.938712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.939774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.940170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.940566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.941340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.941660 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.944455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.953830 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 396/806] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:53.963788 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.992966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58f03-f7da-4fcc-9714-4671e5c7c50a None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.041361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.042623 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.043157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.043678 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.062389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:54.073424 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:54.074478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:54.075931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 411/807] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:54.077475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.081674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.117164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e122e-dad3-420b-b95b-5db06c202643 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.163850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.164935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.165229 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.165517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.179209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.179732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.181039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:54.204262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:54.205367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:54.206349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:54.206349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:54.206349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:54.206349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:54.206349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 397/808] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:54.212309 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.221765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95087-0885-4c72-852d-a844b533ccc6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.261066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.262293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.262880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.263391 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.264468 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:54.265039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.266704 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.277551 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 412/809] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:54.283294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.335278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddb252-4e70-48de-beb7-c0806d67e67b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.359689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.387374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.388574 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.389706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.390213 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.391598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:54.392408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.395070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032ed44-8be9-417c-b0c7-24934a5ba8bf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.418827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 398/810] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:54.420352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcb1ef-c1a9-4c90-adac-94653c11e918 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.420648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcb1ef-c1a9-4c90-adac-94653c11e918 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.420934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcb1ef-c1a9-4c90-adac-94653c11e918 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.423802 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 399/811] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:54.424522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcb1ef-c1a9-4c90-adac-94653c11e918 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.436972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3a6a-a80f-4c64-aa92-e6218967b372 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.478005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.485416 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.486948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.487591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.488219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.503093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.505716 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8b7e6b3f-adac-462e-9fc4-276f6b556951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:54.528676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:54.529737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:54.530732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:54.530732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:54.530732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:54.530732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:54.535021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 413/812] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:54.536713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.537858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.538153 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.543975 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcb1ef-c1a9-4c90-adac-94653c11e918 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.559060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:54.560967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:54.581695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.582986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.583623 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.584663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.594005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.596016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:54.613550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:54.614662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:51:54.615761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:54.618632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 400/813] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:54.619831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.651064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 414/814] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:54.652405 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.661940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.756092 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac79f8-5a5a-4dd8-a19c-316b1df658d7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.780942 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fa49-678f-440e-966f-3f79e5fbbcbc None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.797654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.811558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.812250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.812548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.812834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.813841 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:54.814162 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.816327 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.823243 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:54.824224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:54.824750 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:54.825247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:54.826314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:54.826889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:54.828633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:54.833505 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 401/815] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:54.834465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.848803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 415/816] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:54.852513 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:54.966589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:54.973117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c782e-ecf0-474f-ae33-139b77d1541d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:54.975542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068bf35-a103-44a4-9adf-9927ac9714fa None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.025990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.027225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.028041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.028461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] PATH_INFO: `/v3/services/network` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.029556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.031064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.033593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.035238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.035823 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.036279 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:55.045442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:55.046550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:51:55.047773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:55.049122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.050811 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.051328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 402/817] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:55.052149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:51:55.071786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:55.072885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:51:55.073943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:55.076114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 416/818] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:55.078474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.126704 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:55.173810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb68c41-bd81-42d3-8243-6eb86e2a4a25 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.212638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.214060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.214551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.215076 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.220110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac679-b5d4-4f17-8e4c-88b44fae3369 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.231775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.233307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:55.251532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:55.252567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:55.253560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:55.253560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:55.253560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:55.253560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:55.253560 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 403/819] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:55.254310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.268244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:55.270489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.272491 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.273509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.274032 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.275370 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:55.275922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.278152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.289629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 417/820] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:55.289629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.390290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:55.397314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e46477-79a4-4020-ae3d-531b89e3d3e0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.403638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d1d46-57c1-4ee3-b893-38b769b62580 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.445986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.446823 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.447204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.447322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.447555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.448368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.448519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:55.448876 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.449181 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.449645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.450556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:55.450692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.451306 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.453193 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.469250 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 418/821] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:55.470414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.478818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 404/822] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:55.478818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.550552 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:55.589750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777f4ea-64ca-4aab-8b8a-93f4b460903f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.619511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4338-c7b4-45cb-bb58-49c8530f9992 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.635321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.637190 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.637703 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.638398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.648690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.651083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.658893 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.659763 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.660156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.660546 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.661457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] RBAC: Adding query filter params (type=network) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:55.662417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.663984 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:55.670247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:55.671561 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:55.672671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:55.678988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 419/823] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:55.678988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.679510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 405/824] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:55.680502 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.703829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:55.805433 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fdff5-3b53-46c5-9e5b-9f78a3ecbf6e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.807740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc37b7-02d5-4468-82c1-d084b2930d67 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:55.835418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:55.845796 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.846565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.846990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.847546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.848196 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.850236 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.857910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:55.859204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:55.860178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:55.860821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:55.878816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:55.878816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:55.879694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 406/825] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:51:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:55.880999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:55.894037 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:55.895387 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:55.896997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:55.896997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:55.896997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:55.896997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:55.896997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 420/826] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:55.901941 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.042235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.100767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c83a8-3866-4df8-8644-89f6c712968a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.125385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9acf9-6986-4246-9b6a-03b74ac07924 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.153330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.153929 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.154218 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.154499 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.155326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:56.155644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.157035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e928569-a5d7-4050-9c98-bf018f46941a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.172420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 421/827] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:56.174100 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcecd8e-3c7d-4aec-9342-44b9deb3cb24 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.174396 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcecd8e-3c7d-4aec-9342-44b9deb3cb24 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.174685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcecd8e-3c7d-4aec-9342-44b9deb3cb24 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.175296 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.176275 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 422/828] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:56.176724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.177191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.177688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.178675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:56.179264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.180961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc808187-d2cb-4eea-8b2c-5dec859aa0c2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.181978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcecd8e-3c7d-4aec-9342-44b9deb3cb24 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.199630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 407/829] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:56.201627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.201925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.202206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.223257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:56.224541 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:56.271015 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.315543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcecd8e-3c7d-4aec-9342-44b9deb3cb24 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.318700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 408/830] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:56.320450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.351886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.358247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.359102 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.359396 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.359679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.370180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.376307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:51:56.395989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:56.397596 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:51:56.398633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:56.402379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 423/831] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:56.403217 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.447261 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc5d2-0fc7-4e00-b8bf-aae52dc65af8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.481902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.482822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.483112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.483397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/d325ab6bbdd44fc89bb94922488edd2c/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.497994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=d325ab6bbdd44fc89bb94922488edd2c, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.499510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.504584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28a71-091a-4926-b4cb-da1ef851b021 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.512354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 409/832] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:56 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/d325ab6bbdd44fc89bb94922488edd2c/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:56.513161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.542403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.543268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.543641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.543817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.544503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.545932 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.550969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-5fd58f29-3ab0-46f6-a72e-b61acc664cfa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:56.562266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:56.563684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:56.564628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 424/833] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:56.565548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74100e46-511d-424f-b410-ea99c97def51 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.565548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74100e46-511d-424f-b410-ea99c97def51 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.565548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74100e46-511d-424f-b410-ea99c97def51 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.566954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 425/834] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:56.570015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74100e46-511d-424f-b410-ea99c97def51 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.637565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.651928 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb8b0-9718-4d2d-9a6a-1e7db3bb2653 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.695932 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74100e46-511d-424f-b410-ea99c97def51 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.704660 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.704660 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.704949 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.705210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.706153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:56.706153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.708454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0f00-79c1-43cc-95b6-e2853ec0a525 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.723299 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 410/835] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:56.725431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.726048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.726408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.743421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.744109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.744408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.745166 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.745484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:56.745760 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.746465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:56.747189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.747723 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:56.752353 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 426/836] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:56.752964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.830843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 411/837] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:56.830843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.847921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.862341 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09636cc0-b2bb-481e-b6c7-ccb44fbde941 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.884064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.900122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.901026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.901314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.901598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/25b9ae61f77548dbb5cf43fe320bec53/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.903670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=25b9ae61f77548dbb5cf43fe320bec53, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.905132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.918419 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 427/838] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:51:56 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/25b9ae61f77548dbb5cf43fe320bec53/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:56.919242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.980604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72d3b-86ea-4cec-8408-713aec5fc478 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.046433 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.049087 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.049087 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.049314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.057060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.057390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.058890 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.061973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec08e84-5b35-449e-9f7e-032a34018628 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.071348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 412/839] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:57.108957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.110307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.110892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.111425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.112358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.114263 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:57.129670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:57.130925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:57.132433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 428/840] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:57.138566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.228486 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.259695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa06b1d-ca5c-420e-a4c2-6c8b83a94ba7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.298400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.299137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.299574 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.299862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.300591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.300907 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.302293 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78304073-19bc-4581-8413-3379910e47f0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.308465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 413/841] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:51:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:57.314018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.364948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.427167 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3358f-9c8b-42a2-a991-6e1e3606e80d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.465649 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.466338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.466617 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.466907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.467636 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.467954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.469350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803a9a-7874-412e-8891-3c61e3d82ff3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.479085 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 429/842] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:51:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:58.814126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f7e99-14ea-4ea9-b2fe-a833c8060f5b None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.814672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f7e99-14ea-4ea9-b2fe-a833c8060f5b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.814762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f7e99-14ea-4ea9-b2fe-a833c8060f5b None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.816269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 414/843] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:58.822640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.823133 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.823326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.841204 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:58.842421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:58.917668 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 430/844] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:58.941474 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f7e99-14ea-4ea9-b2fe-a833c8060f5b None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.064093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f7e99-14ea-4ea9-b2fe-a833c8060f5b None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.102759 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a966-e3be-4d79-b1a7-42c918760657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.103545 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a966-e3be-4d79-b1a7-42c918760657 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.103837 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a966-e3be-4d79-b1a7-42c918760657 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.104118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a966-e3be-4d79-b1a7-42c918760657 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.112653 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:59.117727 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948a966-e3be-4d79-b1a7-42c918760657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d948a966-e3be-4d79-b1a7-42c918760657 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:59.126221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:59.127470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:59.128518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 415/845] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:59.136744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.183791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:59.255823 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29611e-388d-44a6-8d33-49dbe1a9fd4f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.288639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e65301-e023-4db8-adfb-fc6d8185e2a7 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.288992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e65301-e023-4db8-adfb-fc6d8185e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.289226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e65301-e023-4db8-adfb-fc6d8185e2a7 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.293272 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.293961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.294258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.294538 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.294657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 416/846] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:59.295403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:59.295719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:59.296201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278b8d3-0739-4758-ab3e-0204b7da0b4e None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.296502 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278b8d3-0739-4758-ab3e-0204b7da0b4e None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.296799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278b8d3-0739-4758-ab3e-0204b7da0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.297105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:59.308510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 431/847] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:59.315771 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.316715 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-2278b8d3-0739-4758-ab3e-0204b7da0b4e None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:59.317959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-2278b8d3-0739-4758-ab3e-0204b7da0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:59.395908 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 417/848] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:51:59.397016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ddd95-0dcc-4780-bc70-a920a629c478 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.397310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ddd95-0dcc-4780-bc70-a920a629c478 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.397595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ddd95-0dcc-4780-bc70-a920a629c478 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.402877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 418/849] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:59.404117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.404407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.404690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.426842 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:59.428994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:59.442070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:59.445875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7a47-6d9a-45c5-b339-d7f70fa6b40d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.484641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.485735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.486201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.486645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.498768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:59.500467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:59.506071 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 419/850] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:51:59.506955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:59.528121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:59.531056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:59.532544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:59.532544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:59.532544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:59.532544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:51:59.532544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 432/851] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:59.534657 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.585210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:59.632385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecce12-4c13-4dc6-9f2c-962fc21488ca None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.652898 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cba6a-20d8-493c-9e14-1b039332c4b0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.671424 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.672285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.672575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.672857 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.684186 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:59.690077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.690756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.691120 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.691410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:59.691836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:59.693484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:59.694522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:51:59.695866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:59.695958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 420/852] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:51:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:59.695958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.699041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:59.714340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 433/853] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:51:59 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:51:59.715203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.733367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:59.839900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefced0-9956-41f6-9178-24363a7507ab None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.856146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c145-4446-4946-91c4-22f2c84086a2 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:59.863657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:59.884209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.884911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.885202 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.885492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.886246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:59.886567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:59.888028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302fd0-fbad-4c1c-9664-48f4bbb31318 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:59.897001 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:59.897691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.897982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.898264 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.899065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:59.899384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:59.900783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b42a-7ccf-4df7-b27c-a25625238376 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:59.902225 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 421/854] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:59.903687 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a9d7-8a77-45ca-adda-bd14381dc2c5 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.903922 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a9d7-8a77-45ca-adda-bd14381dc2c5 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.904210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a9d7-8a77-45ca-adda-bd14381dc2c5 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.905571 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 422/855] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:59.910245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a9d7-8a77-45ca-adda-bd14381dc2c5 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:59.915213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 434/856] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:59.916520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.916819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.917105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.936410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:59.937712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:00.002732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.012439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 435/857] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:51:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:00.013290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.034347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a9d7-8a77-45ca-adda-bd14381dc2c5 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.071046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.072163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.072455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.072742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.080094 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.081540 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:00.096923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:00.098194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:00.099950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 423/858] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:51:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:00.100787 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.134881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10dd62-cb6b-4098-a230-5384f51201d1 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.141964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.172056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.172781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.173073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.173357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.183948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.185529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:00.204626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:00.205743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:00.206824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:00.206824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:00.206824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:00.206824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:00.207927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210c781-cd20-46d2-a1c4-cd7c83ef4174 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.209312 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 436/859] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:00.210289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.249157 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.250145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.250436 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.250719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.251501 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.252881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.270354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 424/860] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:52:00 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:00.272098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.286256 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.350649 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc4f-df96-4682-90ea-16a618be7339 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.407153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.407415 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.408490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.408844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.409585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.410960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:00.411439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.413769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.414581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53174227-ddad-4b9f-94f2-51a1e493fca3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.438488 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 437/861] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:00.444298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.467741 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.468450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.468740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.469070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.470212 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:00.470877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.472769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.494203 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 425/862] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:00.499858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.594724 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c1305-7a9f-4637-8820-7634abc7a700 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.605012 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.625970 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0a4f-1a9a-47be-99b0-002664253c36 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.645112 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.646547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.647096 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.647610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.666514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.667399 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.667686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.668018 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.675769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.677841 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:00.694402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:00.695578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:00.696702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:00.700488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 426/863] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:00.701319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.723153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.748075 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.750419 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.830414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5a565-cb0d-41c4-8d5e-aa5e33fff444 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.871336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 438/864] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:00.874672 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.881101 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.881934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.882231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.882516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.883416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:00.883738 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.885190 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.886232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.911289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 427/865] 10.222.0.71 () {56 vars in 1135 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:00.913057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.998127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.009990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1117ae-a627-436b-8ba1-d87ecfb934d4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.030135 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07f0d-b055-46bd-8723-2408206b033f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.056554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.058202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.059022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.059549 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.065528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.066189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.066481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.066765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.072757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.074505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:01.094399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.095543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.096611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:01.096611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:01.096611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:01.096611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:01.103127 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 439/866] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.105282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.139003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.140615 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.167963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.215899 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4fc64-27c3-462c-ad39-60caf549554d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.218711 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.245057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 428/867] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:01.251818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.256530 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.257491 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.258009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.258517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.259507 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.260072 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.261813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.279058 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 440/868] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.280188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.361889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f3d28-88fb-4ca4-b40d-8881a1a1725f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.388760 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671d4a-8d7a-470a-9deb-1fa9673b632e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.400934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.401754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.402050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.402337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.408361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.415694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.417297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.429189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.430375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.430942 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.431462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.439006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:01.440191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.441217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.442358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:01.442358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:01.442358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:01.442358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:01.444220 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.447642 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 429/869] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.448521 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:01.460621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.461725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:01.463060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:01.470412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 441/870] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.471594 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.480984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.579280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89de86-a678-4c03-9bc5-8c6cdcc4a261 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.588646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0f59-e9fa-4475-98a8-b373fbe90d7e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.620234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.621021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.621320 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.621610 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.622570 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.622935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.624842 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.626015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.626949 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.627225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.630437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.630437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.630437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.630437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.638477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 430/871] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.643953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.649228 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 442/872] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.655843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.707878 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.747427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.761344 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ee94-e2e4-4bfb-8d0f-4bc5dd2fec78 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.794164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56deb6-09a5-4f3e-8fc6-866bff60c4f5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.801394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.803278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.803576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.803864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.815066 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.816585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:01.836447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.837566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:01.838944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 431/873] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:01.841781 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.842817 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.843750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.844313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.844617 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.845515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=d325ab6bbdd44fc89bb94922488edd2c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.845840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.847392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90824a-6942-4952-8e32-e476706901dc None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.860232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 443/874] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/role_assignments?user.id=d325ab6bbdd44fc89bb94922488edd2c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.968754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01664-bf41-4018-9013-e8aca5a5af4e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.007717 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.008416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.008709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.008995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.009817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.010137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.011643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.024130 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da12ebc-d6f4-4c8c-b4a1-3e03cbe2977f None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.024655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da12ebc-d6f4-4c8c-b4a1-3e03cbe2977f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.024765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da12ebc-d6f4-4c8c-b4a1-3e03cbe2977f None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.026254 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 444/875] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:02.032330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 432/876] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:02.033191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.033557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.033917 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.038716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.051187 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.054408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:02.055974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:02.140219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 445/877] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:02.164270 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f6ce0-f235-4546-a0e4-136ac16a8303 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.168863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.210440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.219002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.219988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.220286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.220571 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.222825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=25b9ae61f77548dbb5cf43fe320bec53) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.222825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.226174 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.231195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 433/878] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/role_assignments?user.id=25b9ae61f77548dbb5cf43fe320bec53&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.305874 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c275b6-1576-498b-937d-a8a1aea7a153 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.345449 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.346277 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.346561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.346865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.347552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.349509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:02.362697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:02.364048 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:02.366259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 446/879] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:02.370958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.456684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.491726 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ec2f-2498-4a1d-8b16-e4f10f247af9 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.531376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.532075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.532364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.532651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.533375 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.533694 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.535143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.542036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 434/880] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.548006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.654171 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.662100 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bddc41-509d-4377-a5b9-09b3b5459538 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.697806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.698863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.699378 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.699866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.700847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.701366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.702972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd11b39-f2ad-4e64-a64e-0d06521da703 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.709276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 447/881] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.715602 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.723006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98107-7aca-4ee2-8bd6-50ee76838b4e None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.723299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98107-7aca-4ee2-8bd6-50ee76838b4e None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.723586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98107-7aca-4ee2-8bd6-50ee76838b4e None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.725774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 448/882] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:02.730776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.731093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.731376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.747870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:02.749057 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:02.825398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 449/883] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:02.840290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2461229-1976-441d-b059-d9a404c5cf96 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.849562 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.881001 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.881798 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.882086 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.882530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.883670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] RBAC: Adding query filter params (interface=public, service_id=6dd8577ebe49463aaa16613542fe9fc0, region_id=RegionOne) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.884256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.885639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.889129 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.892695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 435/884] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/endpoints?service_id=6dd8577ebe49463aaa16613542fe9fc0&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.902904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.962665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.975644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903548e-b056-4099-9a46-ad1f7acb1de8 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.016039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.016981 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.017270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.017549 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.018312 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.019768 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:03.034536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:03.036246 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:03.037323 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:03.039431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba57c8-ef8c-410b-972b-4a94cb9a533a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.041889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 450/885] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:03.042945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.094630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.095997 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.096351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.096709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.097932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.099849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.108262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 436/886] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/services => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:03.169950 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0de5-153d-4b7c-b4a3-d6cc62cd47fe None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.210965 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.211658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.211946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.212227 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.213276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.213533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.215003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.221102 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 451/887] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.226778 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.298096 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.339817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3a87-83c1-487b-b6ca-bf18a2a83ea5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.375981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.376655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.376943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.377219 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.377933 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.378248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.379650 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.385689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 437/888] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.391553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.412519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.499213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2937-0bb1-4266-9e29-0a4d30063ec5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.533598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.534263 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.534603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.534916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.535772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] RBAC: Adding query filter params (interface=public, service_id=fda425bb15104e138131464b40d78aaa, region_id=RegionOne) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.536093 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.537523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c19b-db10-40f4-a963-f15379d44d6f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.543056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 452/889] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/endpoints?service_id=fda425bb15104e138131464b40d78aaa&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.548556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.655518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ff7a-a079-4c15-8e0c-635b41914673 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.683408 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.691463 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870c67-625f-4c3b-9fa9-7d5c1afefcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.693301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870c67-625f-4c3b-9fa9-7d5c1afefcd8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.693301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870c67-625f-4c3b-9fa9-7d5c1afefcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.694117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870c67-625f-4c3b-9fa9-7d5c1afefcd8 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.695139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6870c67-625f-4c3b-9fa9-7d5c1afefcd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.696761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6870c67-625f-4c3b-9fa9-7d5c1afefcd8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.703370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 438/890] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:04.429870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69fd4-26a7-4fbb-904e-e080f8171ec8 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.430418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69fd4-26a7-4fbb-904e-e080f8171ec8 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.430517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69fd4-26a7-4fbb-904e-e080f8171ec8 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.432289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 453/891] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:04.438376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09c3c-d2ac-45f9-8350-4694b2b87268 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.438965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09c3c-d2ac-45f9-8350-4694b2b87268 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.438965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09c3c-d2ac-45f9-8350-4694b2b87268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.458247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-76f09c3c-d2ac-45f9-8350-4694b2b87268 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:04.460039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-76f09c3c-d2ac-45f9-8350-4694b2b87268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:04.532137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 439/892] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:04.555078 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69fd4-26a7-4fbb-904e-e080f8171ec8 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.623869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1ad8-4ae0-4c4b-9029-86c728b164f4 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.624565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1ad8-4ae0-4c4b-9029-86c728b164f4 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.625089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1ad8-4ae0-4c4b-9029-86c728b164f4 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.626974 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 440/893] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:04.632882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.633446 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.633992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.651381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:04.652900 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:04.664901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.671418 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69fd4-26a7-4fbb-904e-e080f8171ec8 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.718329 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.719593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.719967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.720363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.734620 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:04.746810 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:04.747945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:04.749020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:04.750482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 454/895] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:04.750707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 441/895] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:04.751681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.772248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.829903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.863079 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa2c74-547c-4de1-a2fa-a0db1cd849cc None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.886371 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67fca0-a233-4d65-ba1a-2ef5d8501dc7 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.901354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.902365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.902903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.903399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.904366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:04.904899 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.906482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.915833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 455/896] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:04.922084 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.928560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.932307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.933391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.933899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.934402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.935912 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.938728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:04.956654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:04.958125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:04.961754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:04.972226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 442/897] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:04.973357 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.061889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b705-7515-4125-b7c8-02fc9ffd5843 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.091425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24fa85-6dbc-4594-b5f3-f1b2c03c8937 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.102504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.103436 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.103799 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.104163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.114319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.117065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.118566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.138615 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:05.138871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:05.139873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:05.140936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:05.140936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:05.140936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:05.140936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:05.142332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.142834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.143311 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.144211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.144924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.145216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 456/898] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:05.146231 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.147028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.157739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 443/899] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.163709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.221834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.274077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcaa72-f7a7-4f68-9a1b-3eda9710c1f5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.292551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2d62a-5eb5-42ce-ad23-dfc8227dc638 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.312930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.314176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.314993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.315515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.316495 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.317031 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.319436 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.336584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.342124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.342124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.342124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.342124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.342124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.342124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6b8d4-b1bd-472c-aeaa-394c99d73380 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.343136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 457/900] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.344998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.348301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 444/901] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.468100 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4e7d-10f6-4597-a0b1-aeafb48e1359 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.489278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.512070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.512910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.513205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.513489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.521964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.523509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.528203 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60b270-2980-42c9-92e7-30bfb45618db None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.528712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60b270-2980-42c9-92e7-30bfb45618db None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.529002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60b270-2980-42c9-92e7-30bfb45618db None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.530720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 445/902] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:05.537936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.537936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.537936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:05.541183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:05.544667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:05.546333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 458/903] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:05.553308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.559187 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:05.561407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:05.611673 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.649889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 446/904] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:05.673519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.690609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97435159-d7e4-4cb8-98d9-439ae5999b11 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.744280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.745618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.746718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.747236 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.748558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.749356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.751950 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.778458 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 459/905] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:05.779938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.799125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b062a00-dfab-474a-98af-29ff1ddcb37b None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.821720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.851389 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306520-0c10-420b-8701-42329785eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.852999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306520-0c10-420b-8701-42329785eb64 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.853564 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306520-0c10-420b-8701-42329785eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.854016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306520-0c10-420b-8701-42329785eb64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.855046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306520-0c10-420b-8701-42329785eb64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.857234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306520-0c10-420b-8701-42329785eb64 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-44306520-0c10-420b-8701-42329785eb64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:05.874592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:05.876072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:05.877275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:05.880749 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 447/906] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:05.888292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306520-0c10-420b-8701-42329785eb64 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.912240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c839-6ac7-4ec1-9336-3e09ba9bcd91 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.946251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.966381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722146-1df6-4b7b-b399-17144c427277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.968030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722146-1df6-4b7b-b399-17144c427277 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.968515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722146-1df6-4b7b-b399-17144c427277 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.969271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722146-1df6-4b7b-b399-17144c427277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.023272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306520-0c10-420b-8701-42329785eb64 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.054573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722146-1df6-4b7b-b399-17144c427277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.056168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722146-1df6-4b7b-b399-17144c427277 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.059026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.059869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.060158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.060438 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.061151 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:06.061461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.062825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1f41-92a5-476d-b7c6-3190ae44d844 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.072781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 448/907] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:06.072781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4c0f5-2c63-4fbd-9842-e56cb792e503 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.072781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4c0f5-2c63-4fbd-9842-e56cb792e503 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.072781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4c0f5-2c63-4fbd-9842-e56cb792e503 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.072781 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 449/908] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:06.076272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4c0f5-2c63-4fbd-9842-e56cb792e503 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.099501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.171379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 460/909] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:52:06.173030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.173549 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.174079 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.191017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:06.192519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:06.195307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4c0f5-2c63-4fbd-9842-e56cb792e503 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.197072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.233945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.234727 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.235071 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.235354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.236078 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:06.236395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.237773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.248011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 450/910] 10.222.0.71 () {56 vars in 1114 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:06.248011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.278025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 461/911] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:06.279064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.350654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.376670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373838-4a16-4f74-a1d6-7ece721150b1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.392126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb4774-5361-4cd8-b2f8-4115f6145c14 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.412778 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.413576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.413880 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.414154 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.425397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.427381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.429450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.430338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.430835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.431321 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.432309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.433914 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:06.445262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:06.446326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:06.447769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:06.447769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:06.447769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:06.447769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:06.447769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 451/912] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:06.447769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.466895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 462/913] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:52:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:06.466895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.471960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.584964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8730e-a17c-459f-99fb-d52f589ddfc8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.622468 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fce08-3e14-4efd-8f56-9dc2337bdf4f None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.642808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.650743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.651624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.651910 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.652191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.652871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.654422 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.664646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.665332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.665624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.665909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.666654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:06.667006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.668417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:06.669517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:06.670591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:06.671644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:06.676188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 452/914] 10.222.0.71 () {56 vars in 1132 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:06.678003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.682229 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 463/915] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:06.687868 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.779041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.805211 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f64c-dbcb-4e89-85ec-3da6ac93fe3d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.806345 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1309c5-3ad1-47e1-9e85-85617be5feb9 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.843018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.844226 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.844719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.845208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.849686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.850470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.850866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.851226 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.852035 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:06.852430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.854291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.855095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.857070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.860918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 453/916] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:06.866546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:06.880156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:06.881237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:06.882299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:06.884908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 464/917] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:06.890116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.936300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.006839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18370a-b3e4-4f23-8e8f-acdd8e9f60bf None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.026157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121fa33-26a3-4f92-9aa1-338438ba79e7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.043959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.044646 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.044925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.045210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.045932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.046246 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.047799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.058273 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 454/918] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:07.059152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.067092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.068159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.068673 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.069182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.070286 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.070919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.072623 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.073033 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.087904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 465/919] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:07.094121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.169509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c107d-8a6a-474e-908b-244dc5792a41 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.203918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.204379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cda48-0072-4cd3-9f09-f43f2e2f494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.205140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cda48-0072-4cd3-9f09-f43f2e2f494d None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.205356 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cda48-0072-4cd3-9f09-f43f2e2f494d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.205639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cda48-0072-4cd3-9f09-f43f2e2f494d None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.206388 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cda48-0072-4cd3-9f09-f43f2e2f494d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.207816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cda48-0072-4cd3-9f09-f43f2e2f494d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.213605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb6ce-f759-4ffb-9833-cbd7e507724e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.234057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 455/920] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:52:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:07.262730 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.263853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.264405 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.264935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.266047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] RBAC: Adding query filter params (role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=d325ab6bbdd44fc89bb94922488edd2c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.266630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.268410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626c101-72bf-4308-8a0d-da8e89c812f4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.275870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 466/921] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/role_assignments?user.id=d325ab6bbdd44fc89bb94922488edd2c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:07.715913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98cb4c-d691-461f-876b-cd13a363e061 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.716490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98cb4c-d691-461f-876b-cd13a363e061 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.716490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98cb4c-d691-461f-876b-cd13a363e061 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.718213 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 456/922] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:07.724970 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf171-37b6-459e-88c6-cfdcf4c50a4f None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.725515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf171-37b6-459e-88c6-cfdcf4c50a4f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.725515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf171-37b6-459e-88c6-cfdcf4c50a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.745500 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-b77cf171-37b6-459e-88c6-cfdcf4c50a4f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:07.746720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-b77cf171-37b6-459e-88c6-cfdcf4c50a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:07.825691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 467/923] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:07.849556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98cb4c-d691-461f-876b-cd13a363e061 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.919627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.957558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98cb4c-d691-461f-876b-cd13a363e061 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.992825 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f1b0-ed3a-435a-9293-d5316967274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.993425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f1b0-ed3a-435a-9293-d5316967274e None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.993718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f1b0-ed3a-435a-9293-d5316967274e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.994007 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f1b0-ed3a-435a-9293-d5316967274e None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.994762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f1b0-ed3a-435a-9293-d5316967274e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.997029 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f1b0-ed3a-435a-9293-d5316967274e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.022944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 457/924] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:52:07 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:08.888393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64899d-e813-4c84-84df-922821d6ad8d None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.888964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64899d-e813-4c84-84df-922821d6ad8d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.888964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64899d-e813-4c84-84df-922821d6ad8d None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.890616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 468/925] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:08.896493 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.896924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.897117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.914539 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:08.915769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:09.006391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 458/926] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:09.029841 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64899d-e813-4c84-84df-922821d6ad8d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.125237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.142777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64899d-e813-4c84-84df-922821d6ad8d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.180203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.180895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.181182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.181462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.182187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.183691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.185076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: WARNING keystone.server.flask.common [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:52:09.204152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.sql.core [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:52:09.204152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:52:09.204152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [parameters: {'id': '46822d575131496ab08c367a6e8e13de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:52:09.204152 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=270181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 46822d575131496ab08c367a6e8e13de.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 46822d575131496ab08c367a6e8e13de. May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:09.222266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application result.read() May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 14:52:09.223319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application yield resource May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise self.value May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application session.commit() May 19 14:52:09.224506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self.session.flush() May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application compat.raise_( May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:52:09.225565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:52:09.226666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application result.read() May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:09.227772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [parameters: {'id': '46822d575131496ab08c367a6e8e13de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.228829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.229806 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 46822d575131496ab08c367a6e8e13de. May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.236385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 469/927] 10.222.0.71 () {60 vars in 1140 bytes} [Thu May 19 14:52:09 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.238002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.289401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.343267 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605d5b-6bba-4d5a-9789-1e5e1d67309d None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.380581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.381400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.381695 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.381983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.389269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.390725 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-88f2fdc3-704f-451a-8b1b-395837f50f5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:09.405444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:09.407789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:09.410170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 459/928] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.416485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.532230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b588000-add6-4310-9b90-266c19884d26 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.567139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.568398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.568985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.569270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.570039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.570350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.572046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf8f90-5b1a-4f15-9784-07a0f0b56de3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.593420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 470/929] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.611697 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c928-453c-490b-9eac-232c81c44317 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.612064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c928-453c-490b-9eac-232c81c44317 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.612268 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c928-453c-490b-9eac-232c81c44317 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.613689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 460/930] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:09.620330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.620698 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.620897 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.626584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.642417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:09.644070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:09.672670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b23be2-e694-4d1e-9ec7-7faa9d238f63 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.672670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b23be2-e694-4d1e-9ec7-7faa9d238f63 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.672670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b23be2-e694-4d1e-9ec7-7faa9d238f63 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.677351 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 461/931] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:09.683823 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.684506 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.685018 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.704399 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:09.706290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:09.725334 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 471/932] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:09.748922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.783982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 462/933] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:09.809927 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.861000 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51b6c1-af8e-4888-92d9-e97c571995f3 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.867762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.899553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.905974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.907242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.907531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.907814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.919245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:09.928497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:09.929658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:09.930674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:09.935071 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 472/934] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.935947 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.940149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee90d2-924f-4ed3-8726-eecab43ad5d8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.983862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.985426 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.985893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.986337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] PATH_INFO: `/v3/services/compute` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.987562 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.990400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.005466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.007054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:10.008289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:10.011365 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 463/935] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.019703 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.064144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab0ade-92b5-42c7-96a1-b2197431a980 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.103564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.104671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.105180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.105708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.106693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.107374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.109062 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.118451 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 473/936] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.124372 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.154462 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011955d-ef0e-42f6-b613-1e7c516c26af None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.164684 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.187561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.203490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.204811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.205116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.205404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.206167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] RBAC: Adding query filter params (name=compute) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.206484 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.208780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.216102 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 464/937] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.224400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.248047 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093bd5-c181-4b9e-b104-66aee518ded7 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.289946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.290765 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.291107 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.291394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.303290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.304854 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:10.323069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.324365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.325654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:10.325654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:10.325654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.325654 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:10.329244 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 474/938] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.330122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.357789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24539d0-bf49-482f-a3cf-4eb434fae99d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.409848 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.410114 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.410391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.410672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.411993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.412316 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.413704 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacbc5a-6fe3-4749-b8d8-9f1a7d8aa7dd None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.418548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 465/939] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.428429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90bcd7-9491-49e9-ad75-6f8d98d5bfbb None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.428788 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90bcd7-9491-49e9-ad75-6f8d98d5bfbb None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.429011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90bcd7-9491-49e9-ad75-6f8d98d5bfbb None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.430511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 466/940] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:10.436453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.436808 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.437032 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.451965 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862295-9c03-40b1-af68-8fa4e054952c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.456085 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:10.457094 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:10.463900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.490404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.510588 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.511326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.511618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.511905 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.512660 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.512980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.514412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.528712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 475/941] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.534580 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.557562 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 467/942] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:10.580734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.679099 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922316f-063b-49e3-bd0c-c24074f9a0fd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.704206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab1bce-53f7-40ea-b171-1951cd2531c3 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.722205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.723056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.723350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.723663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.732779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.734310 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:10.750402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.751579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:10.752713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:10.756231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.756879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 476/943] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.757589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.758111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.758230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.758842 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.759736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.761679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.779772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.780972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:10.781991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:10.789406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 468/944] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:10.790094 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.796164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.833310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.884389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebea662-bf3c-4713-ae7f-6b41aedeac2d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.923184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.923881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.924135 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.924413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.925271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.925593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.928030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.940752 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259b0d-3ccc-41bc-a2d6-0a398c3d3103 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.955088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 477/945] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:10.960331 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.985478 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.986243 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.986459 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.986750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.987541 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.987862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.989784 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.000118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 469/946] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:11.001094 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.083276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.088020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23679ca-9899-4d1f-bba4-b7fe9e636580 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.110030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.122996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2a15a-d5f2-4972-adc0-933e29e15790 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.139194 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.140701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.141491 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.142394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.157797 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.160011 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.161862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.162621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.162957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.163262 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.164085 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.164405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.165878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.176144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 470/947] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.177045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:11.184518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.185614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.186662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:11.186662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:11.186662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:11.186662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:11.188280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 478/948] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:11.194407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.295198 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc467-b8c5-4cfe-b974-007e1b50b742 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.336708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.337386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.337935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.338215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.339039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] RBAC: Adding query filter params (interface=public, service_id=99ba3e14a17e43c6b19c4e4a794db264, region_id=RegionOne) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.339360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.340742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.344217 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067566b-5054-414e-8e2b-c009526e299d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.352391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 471/949] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/endpoints?service_id=99ba3e14a17e43c6b19c4e4a794db264&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.353330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.377952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.394288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.395379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.395931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.396454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.397430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.397974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.400183 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.404313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.423494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 479/950] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:11.424457 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.493310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af63ed-ca77-40fe-b088-985a34379719 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.536725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6868e9-f6d3-4de1-b7c3-afb2da5ea115 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.537797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.538612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.539003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.539395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.540162 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.541681 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.554409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 472/951] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:11.580677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.581890 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.582401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.583453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.592194 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.594033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:11.611024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.612175 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.613245 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:11.615851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 480/952] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:11.622263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.723229 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.740204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787195-3a6b-4e38-a68a-3db1926315ff None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.782137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.782844 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.783141 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.783588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.784399 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.784719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.786194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b836fd-9888-421c-8c7f-8ef556d6561c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.799913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 473/953] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.806249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.868469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.920793 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168ad0-debc-4439-86ef-6927da585448 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.965255 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a675-743e-4908-905f-f4c48f9cc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.966180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a675-743e-4908-905f-f4c48f9cc416 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.966472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a675-743e-4908-905f-f4c48f9cc416 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.966759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a675-743e-4908-905f-f4c48f9cc416 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/d325ab6bbdd44fc89bb94922488edd2c/roles/a2f1a91473714b8f8a8bdfe8a7fbe5bf` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.969221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512a675-743e-4908-905f-f4c48f9cc416 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=d325ab6bbdd44fc89bb94922488edd2c, role_id=a2f1a91473714b8f8a8bdfe8a7fbe5bf)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.970700 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512a675-743e-4908-905f-f4c48f9cc416 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.990706 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 481/954] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:52:11 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/d325ab6bbdd44fc89bb94922488edd2c/roles/a2f1a91473714b8f8a8bdfe8a7fbe5bf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:12.097998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c67270-b739-41f7-91e7-380616411381 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.099158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c67270-b739-41f7-91e7-380616411381 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.099158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c67270-b739-41f7-91e7-380616411381 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.100853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 474/955] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:12.106932 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.107556 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.108105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.127380 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:12.129008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:12.209400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 482/956] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:12.237514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c67270-b739-41f7-91e7-380616411381 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.357301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c67270-b739-41f7-91e7-380616411381 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.394627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.395891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.396188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.396510 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.397189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.398646 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.400162 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: WARNING keystone.server.flask.common [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:52:12.415373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.sql.core [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:52:12.415373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:52:12.415373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [parameters: {'user_id': '71b46b70353a45c39c5d25f66c60a04d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:52:12.415373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=270180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result.read() May 19 14:52:12.423470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:12.424632 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application yield resource May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise self.value May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application session.commit() May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:52:12.425782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.session.flush() May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application compat.raise_( May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:52:12.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:12.429906 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application result.read() May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:12.435797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [parameters: {'user_id': '71b46b70353a45c39c5d25f66c60a04d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:12.438006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 14:52:12.440265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:12.443244 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 475/957] 10.222.0.71 () {60 vars in 1131 bytes} [Thu May 19 14:52:12 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:12.444230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.489576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.548336 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32bee5-6b3a-4e0f-ad8a-0952e19fc180 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.585792 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.587357 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.587916 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.588203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.597156 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.599263 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-f9f58e2c-f41c-432b-80b9-e7748782db90 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:12.616358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:12.618732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:12.621340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 483/958] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:12.626811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.634968 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.746149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9815-c3dd-4af7-8f1a-6d87ed019979 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.782425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.783192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.783469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.783823 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.784691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:12.785013 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.787452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1a58-3b71-42fa-bdb3-70b10e504021 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.787741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1a58-3b71-42fa-bdb3-70b10e504021 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.788021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1a58-3b71-42fa-bdb3-70b10e504021 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.789701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 484/959] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:12.791204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.795894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0320e67-d730-493b-93a4-79895e93ba1b None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.796413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0320e67-d730-493b-93a4-79895e93ba1b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.796935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0320e67-d730-493b-93a4-79895e93ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.814839 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-e0320e67-d730-493b-93a4-79895e93ba1b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:12.816278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-e0320e67-d730-493b-93a4-79895e93ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:12.846819 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 476/960] 10.222.0.71 () {56 vars in 1101 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:12.897315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 485/961] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:12.920585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.999232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:13.039557 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022afaa-4c1b-431f-957b-98746b3ffad0 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.081132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff6166-d18a-4b15-9cd7-d55ff483796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.082139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff6166-d18a-4b15-9cd7-d55ff483796e None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.082670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff6166-d18a-4b15-9cd7-d55ff483796e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.083011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff6166-d18a-4b15-9cd7-d55ff483796e None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.083771 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff6166-d18a-4b15-9cd7-d55ff483796e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.085155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff6166-d18a-4b15-9cd7-d55ff483796e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.106935 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 477/962] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:52:12 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:13.930889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d431e6-fec5-485d-862a-ab03fcab173c None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.931481 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d431e6-fec5-485d-862a-ab03fcab173c None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.931481 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d431e6-fec5-485d-862a-ab03fcab173c None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.932998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 486/963] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:13.938230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.938534 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.938846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.956527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:13.958098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:14.040245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 478/964] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:14.063583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d431e6-fec5-485d-862a-ab03fcab173c None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.100005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.168110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d431e6-fec5-485d-862a-ab03fcab173c None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.206557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.207324 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.207615 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.208490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.209255 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.210642 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-e28d2255-5d20-447d-b806-787ff0698d62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:14.223223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:14.224365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:14.225446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:14.228151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 487/965] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:14.230660 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.286556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.341347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5e10-73c2-4164-bde2-20e4ddf931c9 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.367439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6572-3bcf-4660-bdef-c3102c971e17 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.367792 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6572-3bcf-4660-bdef-c3102c971e17 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.368197 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6572-3bcf-4660-bdef-c3102c971e17 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.370361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 488/966] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:14.375276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.375602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.375886 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.380144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.380821 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.381103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.381386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.382099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:14.382416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.383824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.393723 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 479/967] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:14.394455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.398755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:14.400024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:14.471524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 489/968] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:14.495243 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.500609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf284a-939c-4bb0-b094-80fffbda2e79 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.516644 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.527563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.542676 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.543401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.543696 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.543985 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.544711 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:14.545041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.546415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.552372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 480/969] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:14.558127 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.602625 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c161d17-f58b-4a41-b40c-1dff0f60afa5 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.640417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.641473 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.641917 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.642377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.653253 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:14.662168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:14.663503 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:14.664688 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:14.665567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e456-4b5a-4566-96e3-5b920acd7f4f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.667290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 490/970] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:14.672677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.700016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.700686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.700972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.701250 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.701993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.703402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.734914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 481/971] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:52:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:52:14.788222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.800189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc2be-76ee-48c5-b726-8f61f9786455 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.844833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.845589 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.845885 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.846168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.846971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:14.847292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.849267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.863077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 491/972] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:14.864533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.902764 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.977116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe7ec-e18f-4a24-8d2d-785a14c20c22 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.018115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.019379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.019379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.019567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.031369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.032841 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:15.050846 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:15.052021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:15.053103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:15.053103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:15.053103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:15.053103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:15.053103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 482/973] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:15.059076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.168785 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679057-3ec8-41b3-b0e7-fee4735d9e24 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.205235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.205937 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.206228 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.206510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.207307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.207653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.209708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d87a2-55af-4cdf-99de-2ade37109a49 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.224216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 492/974] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.229733 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.324692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.341589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce24a-7d00-4bd1-86a5-f4d16b22d7d1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.376682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.377683 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.378074 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.378458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.386390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.387978 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.390086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225035-0fc6-48e4-b2c7-81bb96d1e291 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.390386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225035-0fc6-48e4-b2c7-81bb96d1e291 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.390665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225035-0fc6-48e4-b2c7-81bb96d1e291 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.392234 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 493/975] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:15.397062 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.397354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.397640 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:15.403976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:15.405306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:15.406457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 483/976] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:15.412217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.417168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:15.418373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:15.420501 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.486367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 494/977] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:15.509880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.520232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d299c-c500-4d3b-926a-a35313ba3bba None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.556267 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.556953 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.557320 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.557601 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.558361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.560155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.578681 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 484/978] 10.222.0.71 () {56 vars in 1149 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.584569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.588716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.622880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a1bcb-a70e-4976-8030-370023362a1b None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.659055 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.659864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.660157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.660440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] PATH_INFO: `/v3/services/compute` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.661677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.663104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:15.675652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:15.677601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:15.678595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 495/979] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:15.683326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.686051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.704478 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6c1c1-bf20-461a-ba1a-58dd588199fa None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.741988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.742853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.743228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.743575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.790385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c1968-8d80-46d6-b4db-6e941cfdb46d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.820447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.821925 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.825698 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.826725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.827533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.827893 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.828193 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.829001 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] RBAC: Adding query filter params (name=compute) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.829413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.830847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.837063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 496/980] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:15.842872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.917755 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.944760 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 485/981] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:15.945863 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.963051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389950-1595-4f4e-9afb-65d502b70c7e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.998685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.999485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.999850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.000211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.001050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] RBAC: Adding query filter params (type=compute) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.001470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.003043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.014947 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 497/982] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:16.018233 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.063758 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f093-1752-408e-aa7f-316ee45028a5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.068166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.103530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.104578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.104877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.105328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.116547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.118005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.126308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f39e-da47-4f45-ad65-2598fc693a65 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:16.137295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.138414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.139535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:16.139535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:16.139535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:16.139535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:16.143107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 486/983] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:16.144522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.160042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.166592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.167298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.167586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.167865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.168668 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] RBAC: Adding query filter params (interface=public, service_id=3b686f53dffc4bffa04ee660c1123049, region_id=RegionOne) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.168995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.170369 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.175733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 498/984] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/endpoints?service_id=3b686f53dffc4bffa04ee660c1123049&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.181557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.256569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea190-d756-48f9-83cc-2bea7c036edf None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.284346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c457-9fbe-46b2-b300-ca5cf208cbd3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.294908 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.295889 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.296354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.296815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.297827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.298451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.299852 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.316544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 487/985] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.317591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.322871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.323548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.323834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.324112 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.324805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.326187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.342821 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 499/986] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:52:16.349589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.443637 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34896-55da-4882-8159-41d47a9233d9 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.481704 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.482517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.482820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.483112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.490928 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.492409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:16.508338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.509546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:16.510707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 488/987] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:16.517146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.579371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.624912 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a9a6-161b-41b8-9fec-f7502617c36b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.660393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.661139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.661496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.661785 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.662630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.663038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.664486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d00c7-9127-420c-b309-44ce31101860 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.681577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 500/988] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.682835 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.762113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.788394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63637c-e214-423c-b152-678cd764ce87 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.823946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.824619 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.824923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.825209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.826056 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] RBAC: Adding query filter params (role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=d325ab6bbdd44fc89bb94922488edd2c) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.826370 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.827870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f50e-7b2b-4a23-a758-bcba833e609a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.838878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 489/989] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/role_assignments?user.id=d325ab6bbdd44fc89bb94922488edd2c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:17.044613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80c2c-88f2-45d4-9803-721d51920063 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.044967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80c2c-88f2-45d4-9803-721d51920063 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.045195 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80c2c-88f2-45d4-9803-721d51920063 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.047835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 501/990] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:17.054000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.054368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.054745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.073052 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:17.074326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:17.147198 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 490/991] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:17.170689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a80c2c-88f2-45d4-9803-721d51920063 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.274728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a80c2c-88f2-45d4-9803-721d51920063 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.292279 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.309975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.310876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.311106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.311377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.312038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.313413 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:17.325480 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:17.326629 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:17.332637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 502/992] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:17.333583 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.421480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.466692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7fba-3348-4e38-907d-92448ef91b6c None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.502990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.503672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.503956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.504234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.505003 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:17.505316 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.506688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.516350 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 491/993] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:17.517602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.622848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c302e-c72e-474e-ad9c-586729428bf4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.659818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.660506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.661360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.661645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.662366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:17.662685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.664185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.673872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 503/994] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:17.675511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.789961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87737cf5-53b1-4ff3-bc28-ffc2d1f345a2 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.836912 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.837907 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.838193 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.838472 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.839352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] RBAC: Adding query filter params (interface=admin, service_id=99ba3e14a17e43c6b19c4e4a794db264, region_id=RegionOne) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:17.839670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.841042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58933cb5-b7eb-43a2-9b82-83a8d816f871 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.843110 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.850709 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 492/995] 10.222.0.71 () {56 vars in 1249 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/endpoints?service_id=99ba3e14a17e43c6b19c4e4a794db264&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:17.856904 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.908779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.964003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79b550-ee4b-449c-a6be-a4a405e203b2 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.997939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e2058-e93b-407e-9e85-66f91bddf6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.998633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2058-e93b-407e-9e85-66f91bddf6bf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.998939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2058-e93b-407e-9e85-66f91bddf6bf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.999221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2058-e93b-407e-9e85-66f91bddf6bf None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.999927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e2058-e93b-407e-9e85-66f91bddf6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.001374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e2058-e93b-407e-9e85-66f91bddf6bf None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.012017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 504/996] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:52:18.632296 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1784d3-e464-4c44-891d-356728f85cd4 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.632923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1784d3-e464-4c44-891d-356728f85cd4 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.632923 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1784d3-e464-4c44-891d-356728f85cd4 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.634265 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 493/997] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:18.639840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.640297 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.640498 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.660187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:18.661961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:18.732273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 505/998] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:18.755139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1784d3-e464-4c44-891d-356728f85cd4 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.860041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1784d3-e464-4c44-891d-356728f85cd4 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.895768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.896492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.896784 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.897069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] PATH_INFO: `/v3/services/compute` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.897731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.899139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:18.910930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:18.912064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:18.913060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:18.914670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 494/999] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:18.918195 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.966559 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.036338 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29971-3adb-4584-9958-79c9dd23f2e0 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.072549 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.073230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.073520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.073802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.074519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.074861 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.076244 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626d39-32db-4c16-8903-986632c3a3fe None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.086529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 506/1000] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.087882 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.140063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eded2-2611-4ebe-a02d-d8a6a4e1db1a None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.140438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eded2-2611-4ebe-a02d-d8a6a4e1db1a None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.140671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eded2-2611-4ebe-a02d-d8a6a4e1db1a None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.142125 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 507/1001] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:19.148699 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.148907 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.149171 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.156777 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.167895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:19.169101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:19.202638 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8828034-165d-44d4-8333-dfc139eb380e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.240609 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 508/1002] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:19.243361 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.244044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.244336 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.244624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.245415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] RBAC: Adding query filter params (type=compute) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.245731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.247209 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.257487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 495/1003] 10.222.0.71 () {56 vars in 1112 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:19.258604 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.264141 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.294332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.368002 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525df42-b103-4cf9-85e0-83fc15ec00a1 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.371618 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f422d-dde1-4946-8fe2-c5dad89ed215 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.400134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.406585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.407368 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.407602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.407888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.408635 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.410022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.410892 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.411701 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.411992 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.412280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] PATH_INFO: `/v3/services/image` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.412947 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.414315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:19.428173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:19.429421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:19.430584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 496/1004] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:19.443302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 509/1005] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:52:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:19.443556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.556397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26705-c0a0-45e8-a19a-b59a5310949e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.599537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.600231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.600519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.600801 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.601526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] RBAC: Adding query filter params (name=image) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.601844 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.603277 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9378086-4ba7-4ac5-8efd-9b788655b6cc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.613414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 497/1006] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:19.615705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.714300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.726027 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b353d-2096-4e8d-b026-aef40e101163 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.763104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.764092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.764385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.764674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.765402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] RBAC: Adding query filter params (type=image) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.765722 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.767163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a4d93-d7cd-4ae5-837b-3d29756f438e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.778931 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 510/1007] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:20.278446 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d05c2-418e-4188-a468-80f79c94942f None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.278984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d05c2-418e-4188-a468-80f79c94942f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.278984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d05c2-418e-4188-a468-80f79c94942f None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.280385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 498/1008] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:20.286030 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.286408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.286777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.304252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:20.305454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:20.375935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 511/1009] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:20 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:20.399605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d05c2-418e-4188-a468-80f79c94942f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.452819 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.507041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d05c2-418e-4188-a468-80f79c94942f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.541467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.542206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.542497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.542780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.543466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.544845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:20.557516 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:20.558679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:20.559988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:20.563119 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 499/1010] 10.222.0.71 () {56 vars in 1126 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:20.564909 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.652010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.668842 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cebab-8fc1-4792-b130-91e5634420f6 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.704278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.704981 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.705268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.705547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.706280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:20.706594 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.708090 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.718326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 512/1011] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:20.720328 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.824742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1c375-a97e-49d5-b65e-60a360250eaa None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.840026 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.861000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.861673 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.861959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.862236 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.862981 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:20.863288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.865285 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f4ee8-9aaa-4d95-b999-31b13e1534d0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.875155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 500/1012] 10.222.0.71 () {56 vars in 1122 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:20.876264 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.980304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695dfe-c066-4e74-bf22-c8fa0bee0f37 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.022539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8e321-2658-40dd-a57a-843d105664b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.023251 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e321-2658-40dd-a57a-843d105664b5 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.023542 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e321-2658-40dd-a57a-843d105664b5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.023822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e321-2658-40dd-a57a-843d105664b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.024573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8e321-2658-40dd-a57a-843d105664b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.025964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8e321-2658-40dd-a57a-843d105664b5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.042110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 513/1013] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:52:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:21.840457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3073-f7f2-4b87-8b50-ac40c032bd3e None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.841023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3073-f7f2-4b87-8b50-ac40c032bd3e None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.841023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3073-f7f2-4b87-8b50-ac40c032bd3e None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.842829 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 501/1014] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:21.848878 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230003a-1259-478e-8575-eb92c6e108b8 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.849397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230003a-1259-478e-8575-eb92c6e108b8 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.849485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230003a-1259-478e-8575-eb92c6e108b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.866362 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-5230003a-1259-478e-8575-eb92c6e108b8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:21.867597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-5230003a-1259-478e-8575-eb92c6e108b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:21.869860 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.959773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 514/1015] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:21.984578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3073-f7f2-4b87-8b50-ac40c032bd3e None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.018533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a9249-98a5-4f7f-a461-c3bbfeb774e5 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.018849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a9249-98a5-4f7f-a461-c3bbfeb774e5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.020991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a9249-98a5-4f7f-a461-c3bbfeb774e5 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.022518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 515/1016] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:22.029365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.029653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.029937 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.048367 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:22.049585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:22.109961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3073-f7f2-4b87-8b50-ac40c032bd3e None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.123780 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 516/1017] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:22.146469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.147153 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.147345 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.147626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.147916 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.159789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:22.168655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:22.169755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:22.171595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:22.174911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 502/1018] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:22.175748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.219838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.222125 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.272891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d0cca-aa67-4910-9461-eaeff848eab4 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.294901 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd98f2-bb0c-4cc2-9549-af98c5756398 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.311965 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.312655 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.312949 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.313234 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.313990 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.315431 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.330954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 517/1019] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:52:22 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:22.346238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.346996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.347295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.347580 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.348431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.348755 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.350173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.360297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 503/1020] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:22.366482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.483738 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce435-9a9c-4042-af6d-e15191ab9196 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.509846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.524276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.525766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.525766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.525766 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.538559 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.540072 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:22.557880 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:22.559041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:22.560828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:22.560828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:22.560828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:22.560828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:22.560828 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 518/1021] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:22.565346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.669747 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.677604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c11-8492-4ccd-9334-80b44bc87ec1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.715442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.716466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.716984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.717466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.718405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.718994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.720598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.736645 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 504/1022] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:22.743404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.851026 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb86fa7-9911-48eb-b0f5-02e5a91db983 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.886005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.886825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.887116 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.887394 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] PATH_INFO: `/v3/users/nova` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.895759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.897219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:22.912132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:22.913350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:22.914954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:22.918161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 519/1023] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:22.919537 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.030779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378936b-ad1a-47a1-86f7-dd7a7b426760 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.066200 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.067173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.067495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.067775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.068621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:23.068932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.070445 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadb8c3-662e-4111-a102-0d39a511d6d6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.095706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 505/1024] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:23.097070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.135921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.208837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514277d4-d56e-49a9-8d4f-2b50843495af None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.245423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.246106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.246399 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.246686 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.316202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.318139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.351955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.416740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2f62-1471-4222-ae79-b36565f67ffc None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.417073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2f62-1471-4222-ae79-b36565f67ffc None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.417340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2f62-1471-4222-ae79-b36565f67ffc None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.423417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 520/1025] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:23.423557 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 506/1026] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:23.424984 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.429366 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.429948 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.430456 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.452496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:23.454447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:23.467458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.528646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fe702-f2bd-4a17-8371-098a64c64f78 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.540723 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 507/1027] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:23.564041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.566395 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.567774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.568063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.568343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.571537 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.580517 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.582441 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:23.601976 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:23.603460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:23.604555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:23.604555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:23.604555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:23.604555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:23.611149 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 521/1028] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:23.613214 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.677021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802efd09-a197-4b0a-9251-3f51d6025459 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.714355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.715197 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.715539 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.715770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.716971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.718407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.720248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 508/1029] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:23.725793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.728331 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d3d3-7fde-41c5-8601-815a7101f05e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.743497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.765582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.767038 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.767335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.767618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.768355 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:23.768674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.770057 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.782832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 522/1030] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:23.787777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.840144 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54186-10f2-412a-a699-1b84252b5a30 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.841308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.876010 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.876675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.876959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.877242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.877950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.880022 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.898576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee09b4e-35d1-455a-882b-a185cc29bb9b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.912122 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 509/1031] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:52:23 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:52:23.935475 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.936434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.936801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.937159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.946066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.947712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:23.964377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:23.965613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:23.966702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:23.970779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 523/1032] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:23.972182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:24.052194 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:24.099700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dab40-03cd-40ee-8439-9aed9b19c809 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:24.138519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:24.139297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.139584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.139869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.140675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:24.140994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:24.142452 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d841bfc-787f-4bfd-bec1-1b5de1feed09 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:24.156622 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 510/1033] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:24.162493 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:24.266543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6adb-cd76-46b0-ae58-7064adabc164 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:24.276668 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:24.304273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:24.304943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.305232 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.305512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.306347 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] RBAC: Adding query filter params (role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=8088e85aab0b4adcb6c53d99a531515c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:24.306665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:24.308187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cac23-6660-40ab-843b-6f7f0eafbac4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:24.314422 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 524/1034] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:24 2022] GET /identity/v3/role_assignments?user.id=8088e85aab0b4adcb6c53d99a531515c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:24.627308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bf41-45d0-472e-a930-d98248c93933 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.627667 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bf41-45d0-472e-a930-d98248c93933 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.627886 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bf41-45d0-472e-a930-d98248c93933 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.629562 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 511/1035] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:24.635992 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.636486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.636849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.658824 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:24.661210 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:24.738834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 525/1036] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:24.759074 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8bf41-45d0-472e-a930-d98248c93933 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:24.868387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8bf41-45d0-472e-a930-d98248c93933 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:24.894131 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:24.906675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:24.907518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.907807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.908089 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] PATH_INFO: `/v3/services/image` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.908750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:24.910128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:24.922230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:24.924058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:24.930170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 512/1037] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:52:24 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:24.933078 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.047363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cd81-bd39-4012-bc4e-fada412410b1 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.049089 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.089502 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.090184 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.090472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.090756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.091512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] RBAC: Adding query filter params (name=image) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:25.091825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.093266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.098444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 526/1038] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:25.104256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.213955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62089f-5e15-4f6a-8ed5-cf8e1343c5bd None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.249117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.249796 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.250088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.250372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.251176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:25.251496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.252930 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.262741 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 513/1039] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:25.263908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.370866 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5422f-050a-4b4e-b8c8-e14e1d77eec2 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.404902 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.405574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.405864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.406146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.406979 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] RBAC: Adding query filter params (interface=public, service_id=6301ea4a4a44451684b28fc13ff78229, region_id=RegionOne) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:25.407305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.408692 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273c7b7-4f3a-4462-8874-a28a77d6ac8d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.418644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 527/1040] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/endpoints?service_id=6301ea4a4a44451684b28fc13ff78229&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:25.419924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.478142 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.528204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbdf0e-8e15-442a-9b8c-a152eccb89c7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.563146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9ac2-d4ed-49d0-a2e4-6fba5330e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.563828 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9ac2-d4ed-49d0-a2e4-6fba5330e4cb None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.564119 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9ac2-d4ed-49d0-a2e4-6fba5330e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.564405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9ac2-d4ed-49d0-a2e4-6fba5330e4cb None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.565101 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9ac2-d4ed-49d0-a2e4-6fba5330e4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.567048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9ac2-d4ed-49d0-a2e4-6fba5330e4cb None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.574730 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 514/1041] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:26.241108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad3152-9f83-4ff6-8479-4b73d391cd3b None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.241645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad3152-9f83-4ff6-8479-4b73d391cd3b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.241645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad3152-9f83-4ff6-8479-4b73d391cd3b None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.243242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 528/1042] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:26.248315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.248726 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.248898 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.265530 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:26.266720 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:26.335011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 515/1043] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:26.360135 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad3152-9f83-4ff6-8479-4b73d391cd3b None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.393373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.468421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad3152-9f83-4ff6-8479-4b73d391cd3b None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.502623 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1e23-3719-4fff-beb4-e0bbc7a11f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.503447 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1e23-3719-4fff-beb4-e0bbc7a11f9a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.503734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1e23-3719-4fff-beb4-e0bbc7a11f9a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.504056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1e23-3719-4fff-beb4-e0bbc7a11f9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.505235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f1e23-3719-4fff-beb4-e0bbc7a11f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.506669 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f1e23-3719-4fff-beb4-e0bbc7a11f9a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.512938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 529/1044] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.514490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.561854 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.573771 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f16fad-1413-4f4d-9ef7-f19af0e310df None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.574068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f16fad-1413-4f4d-9ef7-f19af0e310df None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.574358 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f16fad-1413-4f4d-9ef7-f19af0e310df None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.575779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 530/1045] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:26.580808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.581109 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.581401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.600518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:26.601653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:26.624591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa361c-514e-414b-a453-1c1f9130820f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.662670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.663535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.663830 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.664116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.664831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.666496 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.683054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 531/1046] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:26.689080 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 516/1047] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:26.702737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.736567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.819630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49245feb-decb-4b7a-b721-c4df69308bb5 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.857104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.857862 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.858150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.858434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.870564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:26.878989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:26.880627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:26.881616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 532/1048] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:26.886961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.998036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208849d6-04bb-4202-be27-2b57e6ae3748 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.999654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.038297 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.039028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.039323 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.039609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.040372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:27.040689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.042070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.050697 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 517/1049] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:27.057196 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.147601 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.162046 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d35f-16d1-456c-a884-3ee8b50c30d8 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.201304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.202110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.202400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.202680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.214448 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.215963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:27.233606 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:27.234643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:27.235746 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:27.235746 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:27.235746 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:27.235746 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:27.239063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 533/1050] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:27.241247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.346016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317570c-c91a-47ff-918e-e649860b398e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.380279 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.380946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.381233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.381514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.382243 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:27.382553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.383955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.396639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 518/1051] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:27.401989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.504980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df53cbf-b560-4152-b225-29522acb84fd None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.543470 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.544662 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.545200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.545689 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.554467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.556342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.559411 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:27.572593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:27.573729 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:27.575289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:27.582782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 534/1052] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:27.583827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.620342 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.723159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e413c-4312-4a62-be51-56201cbe9736 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.759210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.760070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.760454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.760834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.761777 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:27.762192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.763761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5c9e7-a6f6-46bb-a77d-bd6942ed3d79 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.783751 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 519/1053] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:27.790681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.851006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b011-d5dd-4702-9dc8-608d2fbbed6e None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.851372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b011-d5dd-4702-9dc8-608d2fbbed6e None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.851587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b011-d5dd-4702-9dc8-608d2fbbed6e None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.853107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 520/1054] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:27.857951 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.858166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.858447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.881112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:27.882390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:27.911076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fdc4-ae60-42c3-b22e-38e4ba8a6448 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.958340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.959605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.960182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.960477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.964817 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 521/1055] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:27.980851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.980851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.987970 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:28.010010 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.011142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.021421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:28.021421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:28.021421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:28.021421 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:28.021762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.021863 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 535/1056] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:28.027966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.090687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.115521 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cf426-3def-47a1-86fe-3d8c777e40a4 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.143073 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1d7f-dc47-4d3b-957a-dcedecbc2c6e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.151009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.151811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.152105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.152394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] PATH_INFO: `/v3/services/image` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.153061 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.154447 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.167594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.168937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:28.169934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 522/1057] 10.222.0.71 () {56 vars in 1105 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:28.175907 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.184901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.185586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.185882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.186170 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.186938 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.187258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.188648 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.200696 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 536/1058] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:28.206123 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.276251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.306804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555592-3ed5-4b8f-ab70-e177f5661693 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.308451 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6957ca-639b-4db1-ac03-ca903357c140 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.322772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.346457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.347172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.347462 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.348308 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.348519 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.349143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] RBAC: Adding query filter params (name=image) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.349354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.349486 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.349650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.349930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.350851 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.356664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 523/1059] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:28.358067 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.359621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.365255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:28.375305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.376401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:28.377490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 537/1060] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:28.382637 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.476418 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fda0-c420-436a-97b3-3a0bb44fb613 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.498409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90876a03-6279-407f-b16f-a296624cdd16 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.513164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.513855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.514148 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.514432 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.515188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] RBAC: Adding query filter params (type=image) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.515507 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.516891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.527315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 524/1061] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:28.528077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.531999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.536971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.537652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.537942 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.538224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.539168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.539489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.540964 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.558284 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 538/1062] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:28.559550 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.593127 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.642057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345d38-fabf-4f78-8d52-3dec67bed7eb None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.668646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552d8b-11f0-445b-b9f9-2e197b206e7b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.682664 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059604fc-d4b1-47f2-aa41-e866fbd03c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.683656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059604fc-d4b1-47f2-aa41-e866fbd03c22 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.684427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059604fc-d4b1-47f2-aa41-e866fbd03c22 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.684728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059604fc-d4b1-47f2-aa41-e866fbd03c22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.685793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059604fc-d4b1-47f2-aa41-e866fbd03c22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.687864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059604fc-d4b1-47f2-aa41-e866fbd03c22 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.706565 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0de6e-372c-47f2-b963-a94cc3f0f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.707576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0de6e-372c-47f2-b963-a94cc3f0f79e None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.707898 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0de6e-372c-47f2-b963-a94cc3f0f79e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.708167 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0de6e-372c-47f2-b963-a94cc3f0f79e None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/8088e85aab0b4adcb6c53d99a531515c/roles/a2f1a91473714b8f8a8bdfe8a7fbe5bf` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.710248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 525/1063] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:52:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:28.710464 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0de6e-372c-47f2-b963-a94cc3f0f79e None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=8088e85aab0b4adcb6c53d99a531515c, role_id=a2f1a91473714b8f8a8bdfe8a7fbe5bf)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.712247 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0de6e-372c-47f2-b963-a94cc3f0f79e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.730872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 539/1064] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:52:28 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/8088e85aab0b4adcb6c53d99a531515c/roles/a2f1a91473714b8f8a8bdfe8a7fbe5bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:29.058432 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f98c28-2487-4f4c-afdd-96310a1fb26c None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.058779 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f98c28-2487-4f4c-afdd-96310a1fb26c None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.059037 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f98c28-2487-4f4c-afdd-96310a1fb26c None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.060572 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 526/1065] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:29.065676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.065974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.066311 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.084506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:29.085697 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:29.162236 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 540/1066] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:29.185404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f98c28-2487-4f4c-afdd-96310a1fb26c None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.252395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.301826 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f98c28-2487-4f4c-afdd-96310a1fb26c None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.337869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.338988 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.339440 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.339914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.350372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:29.358903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:29.359998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:29.361088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 527/1067] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:29.366106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.385999 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.470218 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17fcbc-f996-4db3-af8e-58e37430c6bc None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.504597 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.505376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.505555 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.505835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.506586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:29.506921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.508294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.521845 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 541/1068] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:29.523215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.624717 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1780b-aae3-44ef-8bbb-c94bf5c5c6dd None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.646238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.661567 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.662449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.662734 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.663051 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] PATH_INFO: `/v3/users/6c12feeb69854d99b52e2bf06dd67845` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.676838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] RBAC: Authorizing `identity:get_user(user_id=6c12feeb69854d99b52e2bf06dd67845)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.678268 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.684458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 528/1069] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/users/6c12feeb69854d99b52e2bf06dd67845 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:29.685725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.770741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.791141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3913e-a956-4d6c-be31-55fea1ceb3bc None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.826180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.826864 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.827157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.827437 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.898638 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.900060 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.983603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:30.008961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 542/1070] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:30.010213 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.126122 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45abe-038e-4655-9d0e-a15d77fc1482 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.161689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3f409-dc9c-4155-bdbe-4e72aabd41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.162489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f409-dc9c-4155-bdbe-4e72aabd41b8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.162776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f409-dc9c-4155-bdbe-4e72aabd41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.163099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f409-dc9c-4155-bdbe-4e72aabd41b8 None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.164291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3f409-dc9c-4155-bdbe-4e72aabd41b8 None admin] RBAC: Authorizing `identity:get_project(project_id=22ded5cd223d40349c1e379987a19081)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.165722 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3f409-dc9c-4155-bdbe-4e72aabd41b8 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.171854 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 529/1071] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:30 2022] GET /identity/v3/projects/22ded5cd223d40349c1e379987a19081 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:30.175056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.272500 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be917-6095-47ce-ad6e-9063f307a104 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.306070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.306718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.307036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.307313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.308140 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=22ded5cd223d40349c1e379987a19081, user.id=6c12feeb69854d99b52e2bf06dd67845) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:30.308468 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.309899 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651d9f-8a2f-411e-9e93-6e9057ae8bd5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.322537 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 543/1072] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:30 2022] GET /identity/v3/role_assignments?user.id=6c12feeb69854d99b52e2bf06dd67845&scope.project.id=22ded5cd223d40349c1e379987a19081&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:31.010337 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f15e5-5ade-4f29-9110-94176fde79f7 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.011060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f15e5-5ade-4f29-9110-94176fde79f7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.011060 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f15e5-5ade-4f29-9110-94176fde79f7 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.012374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 530/1073] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:31.018526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.019876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.020160 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.037733 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:31.038971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:31.059872 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc168-ad39-4083-8979-857c9cd2262f None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.060222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc168-ad39-4083-8979-857c9cd2262f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.060437 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc168-ad39-4083-8979-857c9cd2262f None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.062431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 531/1074] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:31.067656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.067957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.068255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.083191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.085204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:31.086526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:31.113776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 544/1075] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:31.133387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.137927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.162114 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 532/1076] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:31.184379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.242955 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe65b-2442-4c65-881b-d7fef36ed742 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.281344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.282187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.282585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.282901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.289428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ccf62-7da6-4fca-bb18-293907d605c7 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.294253 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:31.303573 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:31.305007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:31.306151 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 545/1077] 10.222.0.71 () {56 vars in 1120 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:31.310674 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.329064 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.329735 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.330036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.330318 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.350940 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.377813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.403103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.404575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.424087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f12407-03de-4fe6-930e-1f38029e2ddb None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.459923 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.460853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.461319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.462039 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.462798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:31.463132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.464510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.473402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 546/1078] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:31.478744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.514879 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 533/1079] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:52:31.521461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.596019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.602182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.602603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e238d6-8a66-4515-9c9c-6060e14c259b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.626989 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c14a-69f8-44dc-adbc-76636099ce07 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.640869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.641675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.641967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.642242 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.654901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.656380 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.664917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.665729 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.666020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.666304 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:31.674836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:31.675974 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:31.677224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:31.677224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:31.677224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:31.677224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:31.677224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 547/1080] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:31.679507 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.680967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.681750 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:31.699693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:31.700770 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:31.702027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:31.702027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:31.702027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:31.702027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:31.702027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 534/1081] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:31.706598 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.798159 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3b7f2-8917-4bb7-800d-06c8b06bb5d1 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.811115 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee2fa-2088-4e74-bbc6-e4a2d5a09d21 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.834696 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.835450 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.835740 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.836020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.837017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:31.837332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.838715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.841760 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.850831 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.855768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.855902 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 548/1082] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:31.856021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.856021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.856021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:31.856021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.856021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.857074 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.868481 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 535/1083] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:31.870319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.994610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127174-d601-479c-bf18-08a238c3ab24 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.037875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.038753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.039020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.039305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] PATH_INFO: `/v3/users/nova` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.047392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.048869 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:32.065401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.067613 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:32.068978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 549/1084] 10.222.0.71 () {56 vars in 1093 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:32.077005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.189512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34948f3f-e485-4cbd-a6a7-5986e5561fd1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.226054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.226745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.227062 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.227347 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.228201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.228523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.229990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8d0a-4462-44e8-84a4-fb7b180864f0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.248201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 536/1085] 10.222.0.71 () {56 vars in 1133 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:32.254429 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.321233 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.355122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99efd94-493d-4fda-9c2f-607b91a8099e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.392007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.392681 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.392970 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.393250 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.463576 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.464962 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.528174 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.555275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006f0b-3aae-4c6a-9997-a610c84532cc None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.555569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006f0b-3aae-4c6a-9997-a610c84532cc None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.555859 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006f0b-3aae-4c6a-9997-a610c84532cc None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.557253 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 537/1086] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:32.562367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.562658 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.568006 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 550/1087] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:32.568183 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.568995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.579924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:32.581113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:32.623606 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.650662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 538/1088] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:32.669237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612fe1-6ebc-41ab-9575-2d9151367313 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.672719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.705299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.706103 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.706393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.706682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.717058 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.718486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:32.735851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.737141 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.739593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:32.739593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:32.739593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:32.739593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:32.739593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 551/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:32.744433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.766660 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.778153 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce9226-8b7a-4e50-bdba-74d92fd2a4ab None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.812982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.813782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.814069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.814349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.825599 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:32.833576 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.835004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:52:32.836167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 539/1090] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:32.840894 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.844163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3be60f-7b70-4c7f-9d64-e531e20fd9cf None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.876042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.880769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.881443 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.881731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.882012 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.882736 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.883081 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.884465 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.895846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 552/1091] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:32.901365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.944400 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f124-f9f7-4304-9c20-e12134fd5130 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.978850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.979469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.979765 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.980051 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.980810 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.981129 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.982355 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.982497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.991355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 540/1092] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:32.997083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.004705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a23fd-f890-4a04-a7d7-50cd8eda4883 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.041927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.042736 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.043054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.043333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.050114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.052230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:33.066414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:33.067687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:33.068922 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 553/1093] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:33.073423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.101587 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.106352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bd44b-bef1-4ecc-9227-b9b84c8b061c None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.140465 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.141359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.141652 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.141934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] PATH_INFO: `/v3/users/6c12feeb69854d99b52e2bf06dd67845` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.143179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] RBAC: Authorizing `identity:get_user(user_id=6c12feeb69854d99b52e2bf06dd67845)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.144657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.146407 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 541/1094] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/users/6c12feeb69854d99b52e2bf06dd67845 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:33.151878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.174595 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696c2db-48ac-4b24-8a2e-fa41bb884e60 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.209288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.210201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.210493 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.210775 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.211853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:33.212205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.213656 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.222892 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.226439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 554/1095] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:33.232568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.253121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c680-b0fb-4991-b244-b733f7f491ac None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.287231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.288237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.288528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.288812 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.290008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=22ded5cd223d40349c1e379987a19081)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.291494 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.293267 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 542/1096] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/projects/22ded5cd223d40349c1e379987a19081 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:33.299011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.334367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.337528 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e717-198a-4083-89f0-b1b78a61ccec None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.371644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.372304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.372591 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.372870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.373704 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] RBAC: Adding query filter params (role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=8088e85aab0b4adcb6c53d99a531515c) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:33.374021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.375502 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1aef6-ca16-4932-b579-8b5be162347d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.381639 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 555/1097] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/role_assignments?user.id=8088e85aab0b4adcb6c53d99a531515c&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=a2f1a91473714b8f8a8bdfe8a7fbe5bf => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:33.401035 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94701ece-351f-4952-a548-e26b8e206dc3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.437995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575a108-8919-4925-a233-48a9ab8aae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.438954 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575a108-8919-4925-a233-48a9ab8aae04 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.439248 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575a108-8919-4925-a233-48a9ab8aae04 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.439540 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575a108-8919-4925-a233-48a9ab8aae04 None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081/users/6c12feeb69854d99b52e2bf06dd67845/roles/40636a8261d645b6a2041281c7044370` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.441739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575a108-8919-4925-a233-48a9ab8aae04 None admin] RBAC: Authorizing `identity:create_grant(project_id=22ded5cd223d40349c1e379987a19081, user_id=6c12feeb69854d99b52e2bf06dd67845, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.443397 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575a108-8919-4925-a233-48a9ab8aae04 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.461134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 543/1098] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:52:33 2022] PUT /identity/v3/projects/22ded5cd223d40349c1e379987a19081/users/6c12feeb69854d99b52e2bf06dd67845/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:52:35.686196 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d0af-715f-4187-925e-f0e5575e385b None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.686811 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d0af-715f-4187-925e-f0e5575e385b None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.686811 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d0af-715f-4187-925e-f0e5575e385b None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.688180 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 556/1099] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:35.694025 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.694463 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.694575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.711080 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:35.712512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:35.777550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 544/1100] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:35.801008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d0af-715f-4187-925e-f0e5575e385b None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.864409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:35.903153 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d0af-715f-4187-925e-f0e5575e385b None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.935472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.936304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.936539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.936816 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.947951 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:35.955715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:35.956959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:35.958342 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 557/1101] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:35.963255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.987474 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:36.063097 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cee9e-d456-48c8-bedd-89095e212019 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:36.096171 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:36.096842 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:36.097670 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:36.097960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:36.098717 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:36.099070 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:36.100449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:36.108452 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 545/1102] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:36.115004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:36.217489 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca26d1-c00c-4ad4-a2d5-e51b0b409a4d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:36.241616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:36.252535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:36.253407 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:36.253696 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:36.253980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] PATH_INFO: `/v3/users/6c12feeb69854d99b52e2bf06dd67845` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:36.255210 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] RBAC: Authorizing `identity:get_user(user_id=6c12feeb69854d99b52e2bf06dd67845)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:36.256677 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:36.258333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 558/1103] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:36 2022] GET /identity/v3/users/6c12feeb69854d99b52e2bf06dd67845 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:36.264160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:36.349130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:36.364401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e54b9-d543-475a-b5ad-ab11a01edf5e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:36.397403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:36.398049 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:36.398341 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:36.398627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:36.464679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:36.466178 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:36.550866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:36.566955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 546/1104] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:36.572831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:36.670428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847151b-b0bd-43d8-b062-17e82bdbf262 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:36.704773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776cdde-0cd2-4b19-a4c7-be01a0f276ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:36.705624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cdde-0cd2-4b19-a4c7-be01a0f276ce None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:36.705906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cdde-0cd2-4b19-a4c7-be01a0f276ce None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:36.706178 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cdde-0cd2-4b19-a4c7-be01a0f276ce None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:36.707401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cdde-0cd2-4b19-a4c7-be01a0f276ce None admin] RBAC: Authorizing `identity:get_project(project_id=22ded5cd223d40349c1e379987a19081)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:36.708843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cdde-0cd2-4b19-a4c7-be01a0f276ce None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:36.710523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 559/1105] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:36 2022] GET /identity/v3/projects/22ded5cd223d40349c1e379987a19081 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:36.716793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:36.814230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8775cdf-8b4d-4d61-add8-6d2c4e135ee3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:36.846950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:36.848135 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:36.848421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:36.848700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:36.849531 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=22ded5cd223d40349c1e379987a19081, user.id=6c12feeb69854d99b52e2bf06dd67845) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:36.849849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:36.851306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd725-d2a4-4e6d-b252-36af3c5b1576 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:36.857022 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 547/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:36 2022] GET /identity/v3/role_assignments?user.id=6c12feeb69854d99b52e2bf06dd67845&scope.project.id=22ded5cd223d40349c1e379987a19081&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.070734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78304-ccfd-4e25-8687-81c8b6c82ca5 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.071265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78304-ccfd-4e25-8687-81c8b6c82ca5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.071376 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78304-ccfd-4e25-8687-81c8b6c82ca5 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.072691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 560/1107] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:39.078004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.078428 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.078578 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.095951 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:39.097175 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:39.141963 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.162936 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 548/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:39.187490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78304-ccfd-4e25-8687-81c8b6c82ca5 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.254600 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.295236 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78304-ccfd-4e25-8687-81c8b6c82ca5 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.331373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7cede-04b4-4f19-9d15-b8fe480e9ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.332168 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7cede-04b4-4f19-9d15-b8fe480e9ec9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.332584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7cede-04b4-4f19-9d15-b8fe480e9ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.332865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7cede-04b4-4f19-9d15-b8fe480e9ec9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.334040 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7cede-04b4-4f19-9d15-b8fe480e9ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.335510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7cede-04b4-4f19-9d15-b8fe480e9ec9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.337395 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 561/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.343135 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.438807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07652b-3a91-4b9a-be6c-724b26db9fe5 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.471767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe584ca-95b3-4ac1-aa6d-c427b8c93d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.472459 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe584ca-95b3-4ac1-aa6d-c427b8c93d44 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.472745 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe584ca-95b3-4ac1-aa6d-c427b8c93d44 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.473028 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe584ca-95b3-4ac1-aa6d-c427b8c93d44 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.473742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe584ca-95b3-4ac1-aa6d-c427b8c93d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.475195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe584ca-95b3-4ac1-aa6d-c427b8c93d44 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.499784 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 549/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:52:39 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:41.933741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e18c4-df86-4136-8377-21078c0d0dfb None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.934326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e18c4-df86-4136-8377-21078c0d0dfb None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.934326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e18c4-df86-4136-8377-21078c0d0dfb None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.935716 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 562/1111] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:41.941707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.942111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.942277 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.959021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:41.960224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:41.991075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:42.030850 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 550/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:42.055157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e18c4-df86-4136-8377-21078c0d0dfb None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:42.157099 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e18c4-df86-4136-8377-21078c0d0dfb None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:42.184335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:42.192588 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:42.193453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.193741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.194023 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] PATH_INFO: `/v3/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.195548 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] RBAC: Authorizing `identity:get_role(role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:42.196940 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:42.198348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 563/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:42 2022] GET /identity/v3/roles/b7343e07f3324924a8676c7aad3628d0 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:42.204355 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:42.305784 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd51dd5-2300-415a-80ec-babe000c18f8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:42.339549 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:42.340409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.340691 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.340965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] PATH_INFO: `/v3/users/0b87fa1b0f1f4acda39465fd41e1e6fe` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.354121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] RBAC: Authorizing `identity:get_user(user_id=0b87fa1b0f1f4acda39465fd41e1e6fe)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:42.355590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:42.357242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 551/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:42 2022] GET /identity/v3/users/0b87fa1b0f1f4acda39465fd41e1e6fe => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:42.363147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:42.461161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c2eb4-b091-40e8-bac1-8d9485ecd784 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:42.494496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:42.495157 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.495446 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.495725 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.555533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:42.562355 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:42.563845 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:42.664118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 564/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:42.670036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:42.695599 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:42.769747 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9350fc7-6b26-4e74-9a8c-3ea70bc02e4b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:42.803363 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e1d51-21e9-4f4c-a7af-250500e51088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:42.804224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1d51-21e9-4f4c-a7af-250500e51088 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.804509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1d51-21e9-4f4c-a7af-250500e51088 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.804788 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1d51-21e9-4f4c-a7af-250500e51088 None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.805957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e1d51-21e9-4f4c-a7af-250500e51088 None admin] RBAC: Authorizing `identity:get_project(project_id=22ded5cd223d40349c1e379987a19081)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:42.807424 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e1d51-21e9-4f4c-a7af-250500e51088 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:42.809105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 552/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:42 2022] GET /identity/v3/projects/22ded5cd223d40349c1e379987a19081 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:42.815287 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:42.908448 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:42.915259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371b98-2d28-44be-9634-2330db85fe43 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:42.948861 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:42.949518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.949808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.950091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.950960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] RBAC: Adding query filter params (role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=22ded5cd223d40349c1e379987a19081, user.id=0b87fa1b0f1f4acda39465fd41e1e6fe) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:42.951285 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:42.952734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057f51d-dfaa-467b-b6e7-c51fdb0b2764 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:42.958373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 565/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:42 2022] GET /identity/v3/role_assignments?user.id=0b87fa1b0f1f4acda39465fd41e1e6fe&scope.project.id=22ded5cd223d40349c1e379987a19081&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.184565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3cbb-23ea-4ae5-9f6a-9ae5f2cda764 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.185128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3cbb-23ea-4ae5-9f6a-9ae5f2cda764 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.185128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3cbb-23ea-4ae5-9f6a-9ae5f2cda764 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.186492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 553/1118] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:45.191717 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.192144 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.192294 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.208749 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:45.209952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:45.275569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 566/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:45.298093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3cbb-23ea-4ae5-9f6a-9ae5f2cda764 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.392840 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:45.403249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3cbb-23ea-4ae5-9f6a-9ae5f2cda764 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.435950 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.436803 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.437084 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.437358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] PATH_INFO: `/v3/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.438848 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] RBAC: Authorizing `identity:get_role(role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.440218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.441627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 554/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/roles/b7343e07f3324924a8676c7aad3628d0 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.447561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.535301 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:45.545320 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb877f-a509-4cfa-b2b6-b6b58dd48916 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.577980 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.578873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.579163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.579444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] PATH_INFO: `/v3/users/0b87fa1b0f1f4acda39465fd41e1e6fe` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.580643 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=0b87fa1b0f1f4acda39465fd41e1e6fe)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.582593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.584267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 567/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/users/0b87fa1b0f1f4acda39465fd41e1e6fe => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.590254 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.689058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35b4b-c16e-4458-bc6e-1c0d530c2aa7 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.723840 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9689a0f-5fce-410e-9cac-f7f561728b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.724693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689a0f-5fce-410e-9cac-f7f561728b00 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.724980 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689a0f-5fce-410e-9cac-f7f561728b00 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.725264 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689a0f-5fce-410e-9cac-f7f561728b00 None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.726437 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9689a0f-5fce-410e-9cac-f7f561728b00 None admin] RBAC: Authorizing `identity:get_project(project_id=22ded5cd223d40349c1e379987a19081)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.727904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9689a0f-5fce-410e-9cac-f7f561728b00 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.729610 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 555/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/projects/22ded5cd223d40349c1e379987a19081 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.735318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.832412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb8549-f2b2-4773-8360-8c1dc2487ef0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.865147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e866-21b0-46a5-b848-914409112e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.866018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e866-21b0-46a5-b848-914409112e9f None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.866308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e866-21b0-46a5-b848-914409112e9f None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.866593 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e866-21b0-46a5-b848-914409112e9f None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081/users/0b87fa1b0f1f4acda39465fd41e1e6fe/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.868825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e866-21b0-46a5-b848-914409112e9f None admin] RBAC: Authorizing `identity:create_grant(project_id=22ded5cd223d40349c1e379987a19081, user_id=0b87fa1b0f1f4acda39465fd41e1e6fe, role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.870257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e866-21b0-46a5-b848-914409112e9f None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.883948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 568/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:52:45 2022] PUT /identity/v3/projects/22ded5cd223d40349c1e379987a19081/users/0b87fa1b0f1f4acda39465fd41e1e6fe/roles/b7343e07f3324924a8676c7aad3628d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:48.092488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc753ec8-47e5-4152-b49e-0a5ebdaa8528 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.093009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc753ec8-47e5-4152-b49e-0a5ebdaa8528 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.093124 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc753ec8-47e5-4152-b49e-0a5ebdaa8528 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.094430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 556/1124] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:48.099701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.100118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.100271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.116644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:48.117819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:48.131230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.184240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 569/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:48.208626 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc753ec8-47e5-4152-b49e-0a5ebdaa8528 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.236624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.308604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc753ec8-47e5-4152-b49e-0a5ebdaa8528 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.342237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.343109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.343401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.343680 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] PATH_INFO: `/v3/roles/b7343e07f3324924a8676c7aad3628d0` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.345141 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] RBAC: Authorizing `identity:get_role(role_id=b7343e07f3324924a8676c7aad3628d0)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.346519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.348005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 557/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/roles/b7343e07f3324924a8676c7aad3628d0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:48.353788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.449498 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65e51a-c892-4a94-a042-cf5569676054 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.482043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.482927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.483218 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.483498 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] PATH_INFO: `/v3/users/0b87fa1b0f1f4acda39465fd41e1e6fe` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.484686 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] RBAC: Authorizing `identity:get_user(user_id=0b87fa1b0f1f4acda39465fd41e1e6fe)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.486146 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.488332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 570/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/users/0b87fa1b0f1f4acda39465fd41e1e6fe => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:48.493945 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.587103 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.597565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79955f-798b-4123-8f99-a0c89ab1da24 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.649325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.649978 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.650295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.650577 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.735607 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.737046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.826173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.832792 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 558/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:48.839074 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.857522 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.937610 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59289c-1a25-44c8-9f9e-d7cd0e009b11 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.982028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385d786-8d78-40af-826f-7b6c6c5b9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.982926 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d786-8d78-40af-826f-7b6c6c5b9dca None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.983222 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d786-8d78-40af-826f-7b6c6c5b9dca None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.983509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d786-8d78-40af-826f-7b6c6c5b9dca None admin] PATH_INFO: `/v3/projects/22ded5cd223d40349c1e379987a19081` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.984705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385d786-8d78-40af-826f-7b6c6c5b9dca None admin] RBAC: Authorizing `identity:get_project(project_id=22ded5cd223d40349c1e379987a19081)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.986164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385d786-8d78-40af-826f-7b6c6c5b9dca None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.988592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 571/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/projects/22ded5cd223d40349c1e379987a19081 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:48.994725 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.093229 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8cc6f-46d1-4172-ac20-d7e2b110d2e4 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.126238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.126938 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.127232 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.127519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.128360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] RBAC: Adding query filter params (role.id=b7343e07f3324924a8676c7aad3628d0, scope.project.id=22ded5cd223d40349c1e379987a19081, user.id=0b87fa1b0f1f4acda39465fd41e1e6fe) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:49.128685 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.130147 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1917d-e4c9-4c6a-b688-86afe2e084ac None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.136043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 559/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/role_assignments?user.id=0b87fa1b0f1f4acda39465fd41e1e6fe&scope.project.id=22ded5cd223d40349c1e379987a19081&role.id=b7343e07f3324924a8676c7aad3628d0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:51.351682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d031461-dfcb-42d7-a4e9-39609670574d None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.352209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d031461-dfcb-42d7-a4e9-39609670574d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.352209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d031461-dfcb-42d7-a4e9-39609670574d None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.353553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 572/1131] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:51.359133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.359550 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.359701 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.376681 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:51.380474 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:51.438004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:51.450035 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 560/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:51.473397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d031461-dfcb-42d7-a4e9-39609670574d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:51.556960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:51.574190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d031461-dfcb-42d7-a4e9-39609670574d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:51.607302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234a33-92a4-450c-87c8-e8f35ab31332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:51.608028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234a33-92a4-450c-87c8-e8f35ab31332 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.608317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234a33-92a4-450c-87c8-e8f35ab31332 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.608598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234a33-92a4-450c-87c8-e8f35ab31332 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.609772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc234a33-92a4-450c-87c8-e8f35ab31332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:51.611257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc234a33-92a4-450c-87c8-e8f35ab31332 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:51.613414 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 573/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:51.619219 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:51.723518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b2f46-53fd-43c5-a0cc-d8fdb19dfada None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:51.756657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40512-4b7b-499f-89e5-1f49a30142dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:51.757310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40512-4b7b-499f-89e5-1f49a30142dc None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.757596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40512-4b7b-499f-89e5-1f49a30142dc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.757876 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40512-4b7b-499f-89e5-1f49a30142dc None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.758579 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca40512-4b7b-499f-89e5-1f49a30142dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:51.760046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca40512-4b7b-499f-89e5-1f49a30142dc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:51.784275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 561/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:52:51 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:54.023925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca898-117c-471c-a91c-21b00828ae69 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.024438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca898-117c-471c-a91c-21b00828ae69 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.025585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca898-117c-471c-a91c-21b00828ae69 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.027051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 574/1135] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:54.032643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74a82-533b-4325-9b93-32794967b97f None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.033093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74a82-533b-4325-9b93-32794967b97f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.033653 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74a82-533b-4325-9b93-32794967b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.051385 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-33e74a82-533b-4325-9b93-32794967b97f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:54.052568 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-33e74a82-533b-4325-9b93-32794967b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:54.086525 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.117820 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 562/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:54.142213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca898-117c-471c-a91c-21b00828ae69 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.242603 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca898-117c-471c-a91c-21b00828ae69 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.275240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419acfa7-c1e8-4d09-9597-3ecbaa0c4425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.275961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acfa7-c1e8-4d09-9597-3ecbaa0c4425 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.276257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acfa7-c1e8-4d09-9597-3ecbaa0c4425 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.276544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acfa7-c1e8-4d09-9597-3ecbaa0c4425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.277736 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419acfa7-c1e8-4d09-9597-3ecbaa0c4425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.279226 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419acfa7-c1e8-4d09-9597-3ecbaa0c4425 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.280837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 575/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:52:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:54.286991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e74a82-533b-4325-9b93-32794967b97f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.382453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e74a82-533b-4325-9b93-32794967b97f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.415690 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d89fd5-f62d-49f8-8c23-aa677e3e81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.416352 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d89fd5-f62d-49f8-8c23-aa677e3e81a0 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.416637 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d89fd5-f62d-49f8-8c23-aa677e3e81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.416915 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d89fd5-f62d-49f8-8c23-aa677e3e81a0 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.417673 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d89fd5-f62d-49f8-8c23-aa677e3e81a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.419126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d89fd5-f62d-49f8-8c23-aa677e3e81a0 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.438105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 563/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:52:54 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:56.681193 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9f64-d258-4cd0-a99d-86436850b556 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.681748 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9f64-d258-4cd0-a99d-86436850b556 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.681748 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9f64-d258-4cd0-a99d-86436850b556 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.683190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 576/1139] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:56.688469 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.688905 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.689019 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.706129 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:56.707588 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:56.730172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.775391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 564/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:52:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:56.797960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b9f64-d258-4cd0-a99d-86436850b556 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.820412 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.898454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b9f64-d258-4cd0-a99d-86436850b556 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:56.932484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:56.933213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.933504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.933788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.944498 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:56.952215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:56.953435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:52:56.954608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 577/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:56.959967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.058251 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b334d9-3388-4ee0-8752-7bd58c9e7a4d None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.091651 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.092329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.092621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.092907 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.093661 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:57.093977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.095389 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.103924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 565/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:57.109759 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.189994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:57.209780 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9ed0-a71b-4a55-a951-4d3de6f306b4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.242398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.243292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.243585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.243871 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] PATH_INFO: `/v3/users/4143e9e32399464da220160cd4d31928` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.257438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] RBAC: Authorizing `identity:get_user(user_id=4143e9e32399464da220160cd4d31928)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.258927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.260574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 578/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/users/4143e9e32399464da220160cd4d31928 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:57.266151 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.288603 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:57.365845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158d3f4-74ac-4362-8d24-4a8102cd1e24 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.399203 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.399848 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.400139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.400422 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.466699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.468109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.488871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:57.564513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 566/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:57.570462 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.666845 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb682ba-5608-4e49-80bc-5247afc06282 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.700440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f9dc3-8e53-4d8e-b219-7ce2dad427af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.701296 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9dc3-8e53-4d8e-b219-7ce2dad427af None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.701585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9dc3-8e53-4d8e-b219-7ce2dad427af None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.701867 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9dc3-8e53-4d8e-b219-7ce2dad427af None admin] PATH_INFO: `/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.703083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f9dc3-8e53-4d8e-b219-7ce2dad427af None admin] RBAC: Authorizing `identity:get_project(project_id=ffb64a20e36e4ae98f8c6cdd2072f934)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.704526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f9dc3-8e53-4d8e-b219-7ce2dad427af None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.706809 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 579/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:57.712979 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.808854 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c9c67-8861-4418-8393-0e23d0d0f815 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.828528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:57.843314 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.843967 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.844252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.844532 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.845360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=ffb64a20e36e4ae98f8c6cdd2072f934, user.id=4143e9e32399464da220160cd4d31928) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:57.845676 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.847146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded14580-395a-4e2b-8ced-670e9abd96b5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.852450 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 567/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/role_assignments?user.id=4143e9e32399464da220160cd4d31928&scope.project.id=ffb64a20e36e4ae98f8c6cdd2072f934&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:00.067240 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4f7f-936a-44b4-be75-7e11b644e424 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.067782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4f7f-936a-44b4-be75-7e11b644e424 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.067782 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4f7f-936a-44b4-be75-7e11b644e424 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.069188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 580/1147] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:00.074712 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.075143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.075334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.092853 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:00.094053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:00.160862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 568/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:00.183486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4f7f-936a-44b4-be75-7e11b644e424 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.192803 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.285696 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4f7f-936a-44b4-be75-7e11b644e424 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.319773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.320560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.320851 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.321132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.331769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:00.339741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:00.341080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:53:00.342101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 581/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:53:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:00.347139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.446168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d48d92-f53d-48f1-bc06-1647ecba6a85 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.459818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.479943 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.480617 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.480908 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.481190 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.481944 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:00.482257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.483675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.492174 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 569/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:00.498172 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.562142 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.596764 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b212bff-f1a3-4144-bee5-48f49de83ebf None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.629665 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.630529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.630836 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.631123 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] PATH_INFO: `/v3/users/4143e9e32399464da220160cd4d31928` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.632317 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] RBAC: Authorizing `identity:get_user(user_id=4143e9e32399464da220160cd4d31928)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.633767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.635429 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 582/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:53:00 2022] GET /identity/v3/users/4143e9e32399464da220160cd4d31928 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:00.641143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.738704 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1794-176f-42eb-9dcf-92401fd35a3b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.773113 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6881-9454-44ee-8d1f-c425fb8de8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.773982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6881-9454-44ee-8d1f-c425fb8de8ef None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.774271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6881-9454-44ee-8d1f-c425fb8de8ef None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.774553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6881-9454-44ee-8d1f-c425fb8de8ef None admin] PATH_INFO: `/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.775767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6881-9454-44ee-8d1f-c425fb8de8ef None admin] RBAC: Authorizing `identity:get_project(project_id=ffb64a20e36e4ae98f8c6cdd2072f934)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.777214 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6881-9454-44ee-8d1f-c425fb8de8ef None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.778938 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 570/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:53:00 2022] GET /identity/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:00.785386 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.882978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f5ec-e70f-4d2f-8fb1-1cb8ed10c48d None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.915346 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7860fc-b547-49fc-9074-c1a9a6c2d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.916225 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7860fc-b547-49fc-9074-c1a9a6c2d550 None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.916510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7860fc-b547-49fc-9074-c1a9a6c2d550 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.916788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7860fc-b547-49fc-9074-c1a9a6c2d550 None admin] PATH_INFO: `/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934/users/4143e9e32399464da220160cd4d31928/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.918754 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7860fc-b547-49fc-9074-c1a9a6c2d550 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffb64a20e36e4ae98f8c6cdd2072f934, user_id=4143e9e32399464da220160cd4d31928, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.920208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7860fc-b547-49fc-9074-c1a9a6c2d550 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.922384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.933794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 583/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:53:00 2022] PUT /identity/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934/users/4143e9e32399464da220160cd4d31928/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:53:03.133271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3dba-09a6-40f5-94f5-f67dd83a439a None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.133833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3dba-09a6-40f5-94f5-f67dd83a439a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.133833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3dba-09a6-40f5-94f5-f67dd83a439a None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.135278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 571/1154] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:03.140586 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984134f-45a1-498f-b897-be9f45838283 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.140988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984134f-45a1-498f-b897-be9f45838283 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.141161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984134f-45a1-498f-b897-be9f45838283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.158328 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0984134f-45a1-498f-b897-be9f45838283 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:03.159592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0984134f-45a1-498f-b897-be9f45838283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:03.226305 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 584/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:03.249621 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3dba-09a6-40f5-94f5-f67dd83a439a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.296546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.351444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3dba-09a6-40f5-94f5-f67dd83a439a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.384924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.385707 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.385994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.386271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.396204 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:03.403756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:03.405123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:53:03.406470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 572/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:03.410925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984134f-45a1-498f-b897-be9f45838283 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.509314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984134f-45a1-498f-b897-be9f45838283 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.531961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.543126 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.543800 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.544090 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.544373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.545128 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:03.545444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.547020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.555313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 585/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:03.561054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.657803 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ceaeb-a7ca-4249-b8af-b6d9ccfd149a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.660140 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.691098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.691956 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.692240 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.692520 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] PATH_INFO: `/v3/users/4143e9e32399464da220160cd4d31928` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.693732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] RBAC: Authorizing `identity:get_user(user_id=4143e9e32399464da220160cd4d31928)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.695186 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.696788 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 573/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/users/4143e9e32399464da220160cd4d31928 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:03.702362 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.800052 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca096c-fdf8-4a69-ae77-660e5381be7a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.832029 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.832666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.832953 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.833236 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.885747 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.899008 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.900467 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.996560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 586/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:04.002339 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.103511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eec98-bf2c-440f-8a06-962741fd91fc None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.135871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17bbe6-5537-415a-b71b-2505d15e4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.136767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17bbe6-5537-415a-b71b-2505d15e4544 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.137054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17bbe6-5537-415a-b71b-2505d15e4544 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.137334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17bbe6-5537-415a-b71b-2505d15e4544 None admin] PATH_INFO: `/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.138512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17bbe6-5537-415a-b71b-2505d15e4544 None admin] RBAC: Authorizing `identity:get_project(project_id=ffb64a20e36e4ae98f8c6cdd2072f934)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.139977 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17bbe6-5537-415a-b71b-2505d15e4544 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.141699 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 574/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/projects/ffb64a20e36e4ae98f8c6cdd2072f934 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:04.148405 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.231832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.253384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fc2e4-e432-4ee9-8313-4204964f4848 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.287065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.287712 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.288001 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.288283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.289119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=ffb64a20e36e4ae98f8c6cdd2072f934, user.id=4143e9e32399464da220160cd4d31928) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:04.289444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.290908 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b788de-d5a7-4250-9f81-f898c829341b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.296664 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 587/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/role_assignments?user.id=4143e9e32399464da220160cd4d31928&scope.project.id=ffb64a20e36e4ae98f8c6cdd2072f934&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:06.515873 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af8847-a973-4361-a681-cce8ae3b4c8b None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.516454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af8847-a973-4361-a681-cce8ae3b4c8b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.516454 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af8847-a973-4361-a681-cce8ae3b4c8b None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.518358 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 575/1162] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:06.523552 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.524007 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.524119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.541326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:06.542515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:06.607791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 588/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:06.629556 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af8847-a973-4361-a681-cce8ae3b4c8b None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:06.672736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:06.731522 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af8847-a973-4361-a681-cce8ae3b4c8b None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:06.775458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:06.776318 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.776746 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.777162 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.851161 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:06.852593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:06.890924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:06.947656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 576/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:53:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:06.953666 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:07.032510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:07.053970 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbca7b1-f0b7-43ef-9850-f181b5528ee2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:07.089477 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:07.090653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.091132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.091581 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.102012 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:07.104074 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-63e23023-f617-4b41-8f45-3902a0868995 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:07.123177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:07.124728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:53:07.126061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 589/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:53:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:07.130584 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:07.231081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6dbe-4f49-405f-a4ab-6dc7a88871da None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:07.263754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:07.264417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.264705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.264987 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.265710 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:07.266023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:07.267422 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cfa1-ea98-4350-a25a-f18cffe281f6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:07.275050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 577/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Thu May 19 14:53:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:09.492148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb13d5-603b-4340-9f15-571ee7046d4f None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.492719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb13d5-603b-4340-9f15-571ee7046d4f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.492719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb13d5-603b-4340-9f15-571ee7046d4f None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.494087 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 590/1167] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:09.499458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cb233-b53c-4db8-bb84-0370a79fe2d7 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.499862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cb233-b53c-4db8-bb84-0370a79fe2d7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.500031 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cb233-b53c-4db8-bb84-0370a79fe2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.506053 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.517058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-4b5cb233-b53c-4db8-bb84-0370a79fe2d7 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:09.518761 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-4b5cb233-b53c-4db8-bb84-0370a79fe2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:09.585547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 578/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:09.608801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb13d5-603b-4340-9f15-571ee7046d4f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.709702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb13d5-603b-4340-9f15-571ee7046d4f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.741906 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e0ad5-fbce-43e6-8f10-67f427460fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.742614 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0ad5-fbce-43e6-8f10-67f427460fb1 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.742882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0ad5-fbce-43e6-8f10-67f427460fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.743171 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0ad5-fbce-43e6-8f10-67f427460fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.743920 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e0ad5-fbce-43e6-8f10-67f427460fb1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.745304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e0ad5-fbce-43e6-8f10-67f427460fb1 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.754494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.761567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 591/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Thu May 19 14:53:09 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:12.001971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78a23d-cd3e-4f95-8407-27369c33c623 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.002555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78a23d-cd3e-4f95-8407-27369c33c623 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.002555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78a23d-cd3e-4f95-8407-27369c33c623 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.003976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 579/1170] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:12.009318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.009744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.009891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.026540 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:12.027772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:12.093111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 592/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:12.117292 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78a23d-cd3e-4f95-8407-27369c33c623 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.217333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78a23d-cd3e-4f95-8407-27369c33c623 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.251364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf16a-5337-4e3a-ab1d-074902995039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.252305 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf16a-5337-4e3a-ab1d-074902995039 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.252548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf16a-5337-4e3a-ab1d-074902995039 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.252834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf16a-5337-4e3a-ab1d-074902995039 None admin] PATH_INFO: `/v3/domains/15689687aa224303a6d89e1edddfc419` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.254780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.264329 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf16a-5337-4e3a-ab1d-074902995039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=15689687aa224303a6d89e1edddfc419)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.265775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf16a-5337-4e3a-ab1d-074902995039 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.267483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 580/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/domains/15689687aa224303a6d89e1edddfc419 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:12.273202 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.371355 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40388fe-5a0d-4e91-a414-05d4fb9d7aa7 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.398983 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.405209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2156b-5469-4de3-853b-c9fc97757b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.405877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2156b-5469-4de3-853b-c9fc97757b11 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.406169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2156b-5469-4de3-853b-c9fc97757b11 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.406455 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2156b-5469-4de3-853b-c9fc97757b11 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.407219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2156b-5469-4de3-853b-c9fc97757b11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.409270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2156b-5469-4de3-853b-c9fc97757b11 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.433707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 593/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:53:12 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:14.687834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb7e7-5b0f-4d9e-aebc-5b1ffa7859d2 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.688412 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb7e7-5b0f-4d9e-aebc-5b1ffa7859d2 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.688412 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb7e7-5b0f-4d9e-aebc-5b1ffa7859d2 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.689838 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 581/1174] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:14.695260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.695687 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.695822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.713045 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:14.714219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:14.778719 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 594/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:14.803306 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb7e7-5b0f-4d9e-aebc-5b1ffa7859d2 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:14.907102 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb7e7-5b0f-4d9e-aebc-5b1ffa7859d2 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:14.941742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fab6bd-3b01-41cd-983d-9fede331aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:14.942539 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab6bd-3b01-41cd-983d-9fede331aa57 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.942851 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab6bd-3b01-41cd-983d-9fede331aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.943138 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab6bd-3b01-41cd-983d-9fede331aa57 None admin] PATH_INFO: `/v3/domains/15689687aa224303a6d89e1edddfc419` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.944326 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fab6bd-3b01-41cd-983d-9fede331aa57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=15689687aa224303a6d89e1edddfc419)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:14.945762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fab6bd-3b01-41cd-983d-9fede331aa57 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:14.947417 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 582/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Thu May 19 14:53:14 2022] GET /identity/v3/domains/15689687aa224303a6d89e1edddfc419 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:14.953182 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:15.049283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1903e5-aca3-4514-9150-bb98fd09ab02 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:15.061831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:15.084055 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3e74f-3b79-47f4-8488-038a267c28c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:15.084731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3e74f-3b79-47f4-8488-038a267c28c5 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:15.085270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3e74f-3b79-47f4-8488-038a267c28c5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:15.085569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3e74f-3b79-47f4-8488-038a267c28c5 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:15.086280 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3e74f-3b79-47f4-8488-038a267c28c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:15.087772 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3e74f-3b79-47f4-8488-038a267c28c5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:15.108309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 595/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:53:14 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:17.386039 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f8e1-f6d6-47e5-8d81-924c8f7f4d50 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.386586 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f8e1-f6d6-47e5-8d81-924c8f7f4d50 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.386586 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f8e1-f6d6-47e5-8d81-924c8f7f4d50 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.387949 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 583/1178] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:17.393276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.393762 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.393876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.410992 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:17.412192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:17.477626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 596/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:17.501050 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f8e1-f6d6-47e5-8d81-924c8f7f4d50 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:17.563149 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:17.603542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f8e1-f6d6-47e5-8d81-924c8f7f4d50 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:17.637162 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:17.637887 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.638176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.638458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.649131 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:17.656649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:17.658558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:53:17.660164 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 584/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:17.664506 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:17.766441 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:17.771118 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181b406-43d8-4e32-9be9-d63ac7e936a1 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:17.804959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:17.805627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.805915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.806193 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.806975 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:17.807289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:17.808670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:17.816505 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 597/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:17.822277 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:17.921172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fd0fc-857b-49d6-82b7-7e513a6b192b None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:17.942867 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:17.954334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:17.955772 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.956054 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.956332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] PATH_INFO: `/v3/users/2909fa79f24a402985e6dbdba91b2cc1` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.969535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] RBAC: Authorizing `identity:get_user(user_id=2909fa79f24a402985e6dbdba91b2cc1)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:17.971023 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:17.972652 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 585/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:53:17 2022] GET /identity/v3/users/2909fa79f24a402985e6dbdba91b2cc1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:17.978307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:18.076221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a76da-8413-42c0-8d6c-e6f7d3505c83 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:18.109371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:18.110011 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:18.110302 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:18.110585 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:18.137856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:18.177043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:18.178441 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:18.273973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 598/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:53:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:18.279888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:18.385776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2276717-37ab-4634-9c25-5f78aa52f469 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:18.418205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b33d20-174a-4cbd-a314-5322dd38e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:18.419098 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b33d20-174a-4cbd-a314-5322dd38e915 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:18.419384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b33d20-174a-4cbd-a314-5322dd38e915 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:18.419666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b33d20-174a-4cbd-a314-5322dd38e915 None admin] PATH_INFO: `/v3/projects/423169d937e84632b9565c5e0162e5d3` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:18.420829 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b33d20-174a-4cbd-a314-5322dd38e915 None admin] RBAC: Authorizing `identity:get_project(project_id=423169d937e84632b9565c5e0162e5d3)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:18.422258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b33d20-174a-4cbd-a314-5322dd38e915 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:18.424577 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 586/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:53:18 2022] GET /identity/v3/projects/423169d937e84632b9565c5e0162e5d3 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:18.430767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:18.488374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:18.528104 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10b13-6bba-433b-9a40-c7fd2ae1e569 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:18.562059 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:18.562701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:18.563014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:18.563297 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:18.564757 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=423169d937e84632b9565c5e0162e5d3, user.id=2909fa79f24a402985e6dbdba91b2cc1) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:18.565079 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:18.566510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bce2c-e7dd-45e7-9b7e-acdb2e792d50 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:18.572177 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 599/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:53:18 2022] GET /identity/v3/role_assignments?user.id=2909fa79f24a402985e6dbdba91b2cc1&scope.project.id=423169d937e84632b9565c5e0162e5d3&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:20.767528 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16866d0-5b77-4e5c-ba25-6b8a9d475e4d None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:20.768085 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16866d0-5b77-4e5c-ba25-6b8a9d475e4d None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:20.768230 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16866d0-5b77-4e5c-ba25-6b8a9d475e4d None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:20.769512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 587/1186] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:20.774623 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:20.775092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:20.775237 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:20.791794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:20.793296 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:20.858189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 600/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:20.881633 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16866d0-5b77-4e5c-ba25-6b8a9d475e4d None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:20.931325 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:20.983116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16866d0-5b77-4e5c-ba25-6b8a9d475e4d None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.016870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.017768 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.017940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.018222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.028509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:21.036665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:21.037965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:53:21.039395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 588/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:21.043849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.100022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:21.144013 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8690e8-86d9-4234-8d4f-5a5245e18687 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.179569 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.180239 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.180529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.180814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.181564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:21.181881 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.183313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.191266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 601/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:21.197310 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.296750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba06b3d-0f46-48fd-8813-81a59d14a20a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.306009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:21.331689 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.332564 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.332858 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.333145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] PATH_INFO: `/v3/users/2909fa79f24a402985e6dbdba91b2cc1` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.334341 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] RBAC: Authorizing `identity:get_user(user_id=2909fa79f24a402985e6dbdba91b2cc1)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.336063 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.337700 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 589/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:53:21 2022] GET /identity/v3/users/2909fa79f24a402985e6dbdba91b2cc1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:21.343533 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.442259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4c91-a04b-413c-bbcd-00458e48d5ee None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.459040 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:21.478129 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b517a4a-6ec6-46d0-8c27-d75cab74bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.479020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517a4a-6ec6-46d0-8c27-d75cab74bcca None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.479307 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517a4a-6ec6-46d0-8c27-d75cab74bcca None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.479587 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517a4a-6ec6-46d0-8c27-d75cab74bcca None admin] PATH_INFO: `/v3/projects/423169d937e84632b9565c5e0162e5d3` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.480773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517a4a-6ec6-46d0-8c27-d75cab74bcca None admin] RBAC: Authorizing `identity:get_project(project_id=423169d937e84632b9565c5e0162e5d3)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.482218 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517a4a-6ec6-46d0-8c27-d75cab74bcca None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.483963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 602/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:53:21 2022] GET /identity/v3/projects/423169d937e84632b9565c5e0162e5d3 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:21.489914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.589151 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0da8e-03e0-4104-be68-6931fe40d43d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.622040 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deade4e-4fe0-4a81-9b1e-02a800a38799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.622955 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deade4e-4fe0-4a81-9b1e-02a800a38799 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.623249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deade4e-4fe0-4a81-9b1e-02a800a38799 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.623535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deade4e-4fe0-4a81-9b1e-02a800a38799 None admin] PATH_INFO: `/v3/projects/423169d937e84632b9565c5e0162e5d3/users/2909fa79f24a402985e6dbdba91b2cc1/roles/40636a8261d645b6a2041281c7044370` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.625509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deade4e-4fe0-4a81-9b1e-02a800a38799 None admin] RBAC: Authorizing `identity:create_grant(project_id=423169d937e84632b9565c5e0162e5d3, user_id=2909fa79f24a402985e6dbdba91b2cc1, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.627005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deade4e-4fe0-4a81-9b1e-02a800a38799 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.641611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 590/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:53:21 2022] PUT /identity/v3/projects/423169d937e84632b9565c5e0162e5d3/users/2909fa79f24a402985e6dbdba91b2cc1/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:53:23.854937 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12e46-b7e5-4ad4-8fb4-41c908e53228 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:23.855514 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12e46-b7e5-4ad4-8fb4-41c908e53228 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:23.855514 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12e46-b7e5-4ad4-8fb4-41c908e53228 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:23.856872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 603/1193] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:23.862633 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:23.863109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:23.863233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:23.880406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:23.881592 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:23.909643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:23.949065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 591/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:53:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:23.972785 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12e46-b7e5-4ad4-8fb4-41c908e53228 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.076213 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12e46-b7e5-4ad4-8fb4-41c908e53228 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.115235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.115950 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.116243 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.116526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.127265 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:24.135015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:24.140849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:53:24.142238 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 604/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:53:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:24.143395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.239648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fb7b3-d795-4a46-b8b1-9a79c0331ae6 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.272171 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.272836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.273122 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.273402 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.274145 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:24.274455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.275859 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.284332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 592/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:53:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:24.290022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.335360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.388304 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8afc-6bdb-49e7-b2ca-95886f8d1261 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.421273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.422129 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.422440 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.422683 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] PATH_INFO: `/v3/users/2909fa79f24a402985e6dbdba91b2cc1` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.423939 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] RBAC: Authorizing `identity:get_user(user_id=2909fa79f24a402985e6dbdba91b2cc1)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.425377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.427021 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 605/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu May 19 14:53:24 2022] GET /identity/v3/users/2909fa79f24a402985e6dbdba91b2cc1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:24.432566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.461606 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.531964 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cb97-af34-4c82-8a7c-e90e2db7602a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.564743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.565381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.565669 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.565951 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.631517 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.632959 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.659705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.728986 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 593/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:53:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:24.735041 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.832215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec8ba-db2d-445e-af1c-19e6e565aa7b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.845250 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.865849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6619d3-6922-4886-a9f0-3991e3c9c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.866705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6619d3-6922-4886-a9f0-3991e3c9c900 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.867020 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6619d3-6922-4886-a9f0-3991e3c9c900 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.867300 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6619d3-6922-4886-a9f0-3991e3c9c900 None admin] PATH_INFO: `/v3/projects/423169d937e84632b9565c5e0162e5d3` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.868469 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6619d3-6922-4886-a9f0-3991e3c9c900 None admin] RBAC: Authorizing `identity:get_project(project_id=423169d937e84632b9565c5e0162e5d3)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.869911 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6619d3-6922-4886-a9f0-3991e3c9c900 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.871628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 606/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu May 19 14:53:24 2022] GET /identity/v3/projects/423169d937e84632b9565c5e0162e5d3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:24.878288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.975804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a022b2-b570-4215-b165-0499ca523be6 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:25.002483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:25.010486 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:25.011169 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:25.011455 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:25.011732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:25.012563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=423169d937e84632b9565c5e0162e5d3, user.id=2909fa79f24a402985e6dbdba91b2cc1) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:25.012877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:25.014307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b731099-c3e9-4388-82ef-b3723a29c4cf None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:25.020862 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 594/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:53:24 2022] GET /identity/v3/role_assignments?user.id=2909fa79f24a402985e6dbdba91b2cc1&scope.project.id=423169d937e84632b9565c5e0162e5d3&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:34.861773 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=10 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:35.018606 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=4 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:23.008658 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176b1a4-c6be-4bdd-8382-16ddbc28bd07 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:23.009257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176b1a4-c6be-4bdd-8382-16ddbc28bd07 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:23.009257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176b1a4-c6be-4bdd-8382-16ddbc28bd07 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:23.010779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 607/1201] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:23.018163 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:23.018675 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:23.018815 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:23.036999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:23.038195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:23.109962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 595/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:23.134251 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176b1a4-c6be-4bdd-8382-16ddbc28bd07 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:23.254264 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176b1a4-c6be-4bdd-8382-16ddbc28bd07 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:23.290324 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:23.291080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:23.291370 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:23.291652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:23.302653 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:23.304187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:23.322758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:23.324176 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:23.325381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:23.325381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:23.325381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:23.325381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:23.325381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 608/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:23.331000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:23.447601 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1da26-2bb7-4135-941e-0377f6e3dcd7 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:23.479662 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:23.487771 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:23.488126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:23.488412 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:23.492414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:23.492414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:23.492414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:23.492414 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9beb6-24ff-44ad-a1a8-b98a45bd22b4 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:23.507263 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 596/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:23.513092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:23.569895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:23.626076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc63f8d-35a9-41fb-a525-e33a17fd0a53 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:23.674843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056424-1769-4be2-b26d-726d9d4dd997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:23.674843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056424-1769-4be2-b26d-726d9d4dd997 None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:23.674843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056424-1769-4be2-b26d-726d9d4dd997 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:23.674843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056424-1769-4be2-b26d-726d9d4dd997 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:23.675972 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056424-1769-4be2-b26d-726d9d4dd997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:23.678014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056424-1769-4be2-b26d-726d9d4dd997 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:23.704211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 609/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Thu May 19 14:54:23 2022] POST /identity/v3/users => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:54:26.419612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91003c-d106-4e22-8e33-f32fe9e594f8 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:26.420191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91003c-d106-4e22-8e33-f32fe9e594f8 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:26.420191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91003c-d106-4e22-8e33-f32fe9e594f8 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:26.422509 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 597/1206] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:26.429868 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:26.430398 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:26.430520 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:26.449827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:26.452172 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:26.530641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 610/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:26.560398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91003c-d106-4e22-8e33-f32fe9e594f8 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:26.678870 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91003c-d106-4e22-8e33-f32fe9e594f8 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:26.720392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:26.721257 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:26.721548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:26.721869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:26.733546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:26.741416 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:26.743034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:26.744379 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 598/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:54:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:26.754843 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:26.799775 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:26.884040 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a3341-ff2a-4e29-b2f3-5b3916c80ab2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:26.926364 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:26.927149 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:26.927494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:26.927959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:26.928791 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:26.929233 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:26.930834 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:26.945416 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 611/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:54:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:54:26.953482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:27.024904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:27.095122 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1025a97-8f2f-4761-ba08-e9e9c6bd1e2d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:27.140869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:27.142008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:27.142558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:27.142939 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:27.155914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:27.157429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:27.177706 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:27.179179 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:27.180468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:27.180468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:27.180468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:27.180468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:27.180468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 599/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:27.184899 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:27.300889 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:27.305377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a92570-81da-44e0-9027-0c710ac948eb None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:27.347318 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:27.348015 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:27.348322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:27.348657 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:27.349425 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:27.349790 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:27.351393 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:27.365181 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 612/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:27.370856 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:27.492038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269511b-c3d5-4182-a032-d85f39a14213 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:27.493737 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:27.536058 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:27.537303 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:27.537555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:27.537799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:27.547117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:27.548595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:54:27.567724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:27.570971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:27.572237 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 600/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:27.574769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:27.693299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533d598-9f62-418c-9600-05ae4d3571a3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:27.735332 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:27.736024 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:27.736293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:27.736611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:27.737461 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:27.737827 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:27.739363 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:27.762409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 613/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:54:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:27.763551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:27.879168 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb2c16-f0de-411a-98f4-85cfbbc617a1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:27.919750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:27.920458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:27.920754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:27.921044 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:27.956004 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:28.007804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:28.009319 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:28.133946 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 601/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:54:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:54:28.140679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:28.163061 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:28.255671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f76a5-3c5c-4673-bfe5-022138868183 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:28.294117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:28.295652 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:28.296064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:28.296466 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:28.310005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:28.312896 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:28.336201 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:28.337568 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:28.339043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:28.339043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:28.339043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:28.339043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:28.340474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 614/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:28.354166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:28.433663 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:28.478301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910862d-c512-4101-a60b-3c8388253b6d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:28.518184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:28.518984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:28.519453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:28.519740 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:28.520563 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:28.520893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:28.522594 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:28.537160 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 602/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:28.542616 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:28.633110 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:28.676644 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca3f9-7d58-4242-91cd-bae48b86c9f6 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:28.717408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:28.718918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:28.719808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:28.720194 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:28.728235 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:28.730092 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:54:28.746258 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:28.748290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:28.756993 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 615/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:54:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:28.759960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:28.883338 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc3a9f-8570-4f91-b07e-611fd29b7e20 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:28.908546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:28.921477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:28.922158 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:28.922442 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:28.922721 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:28.923566 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:28.923903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:28.925335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb64c-05ae-4ea4-886d-8eed35e86d35 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:28.938301 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 603/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:28.946526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:29.102536 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c508e-c019-4210-b696-79b06e764b27 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:29.143844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:29.151231 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:29.152072 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:29.152529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:29.152823 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:29.154004 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=4176a445c2524d408292b045cf6d6926) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:29.155114 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:29.157063 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a14f6-ff5e-439d-9bba-bc4607b2d6fb None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:29.174826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 616/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:54:28 2022] GET /identity/v3/role_assignments?user.id=4176a445c2524d408292b045cf6d6926&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:31.558775 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddd54-d9aa-41fc-89c1-faca684e18be None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:31.559381 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddd54-d9aa-41fc-89c1-faca684e18be None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:31.559500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddd54-d9aa-41fc-89c1-faca684e18be None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:31.560998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 604/1220] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:31.569064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:31.569064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:31.569064 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:31.587753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:31.588947 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:31.676326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 617/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:31.705272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddd54-d9aa-41fc-89c1-faca684e18be None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:31.843479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddd54-d9aa-41fc-89c1-faca684e18be None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:31.887005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:31.887816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:31.888112 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:31.888394 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:31.900780 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:31.910995 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:31.912374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:31.913404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 605/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:54:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:31.918510 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:32.025392 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bee36-a321-48ad-9898-1d9e9ad205c7 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:32.051702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:32.063776 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:32.064523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:32.064875 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:32.065164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:32.065956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] RBAC: Adding query filter params (name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:32.066269 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:32.067720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:32.076963 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 618/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:32.083169 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:32.133834 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:32.199480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2d908-de89-4784-a255-01d7e85356a8 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:32.237242 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:32.238045 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:32.238334 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:32.238617 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:32.250468 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:32.252075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:32.270708 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:32.272038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:32.273511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:32.273511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:32.273511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:32.273511 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:32.276608 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 606/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:32.278117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:32.395988 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799a3c3-eec0-4684-8b52-ebbf43f9abac None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:32.437745 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:32.438509 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:32.438813 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:32.439113 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:32.439847 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:32.440163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:32.441728 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:32.457878 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 619/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:54:32.463624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:32.569093 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:32.578557 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e638e2-24d9-4e84-bc9f-807b6e4b7d0a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:32.617807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:32.618627 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:32.618962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:32.619256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:32.627092 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:32.628589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:54:32.645057 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:32.646475 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:32.647909 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 607/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:32.652487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:32.723122 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:32.780998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8ce8-82ff-4850-8685-f049209b46a0 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:32.820460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:32.821155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:32.821444 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:32.821723 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:32.822575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:32.822946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:32.824422 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:32.842582 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 620/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:54:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:32.848278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:32.956041 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732c3c-f2a8-44ac-8283-79236adfdac5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:32.995406 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:32.996222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:32.996514 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:32.996793 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:33.014350 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:33.016731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:33.042369 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:33.050845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:33.052340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:33.052340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:33.052340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:33.052340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:33.052340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 608/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:33.052794 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:33.164295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddd2b2-856a-4214-bfc8-a7183457427c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:33.167192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:33.205460 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:33.206189 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:33.206431 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:33.206713 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:33.207734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:33.208051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:33.209434 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:33.222216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 621/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:33.227998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:33.238993 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:33.337609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787dd63-6513-4319-a90b-da4feadaf179 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:33.373575 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:33.374388 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:33.374677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:33.375029 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:33.382371 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:33.383813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:54:33.399789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:33.401011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:33.403641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 609/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:33.407994 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:33.528198 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dfaa-5cdf-439a-8f17-8020689d4ae3 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:33.566029 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:33.567066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:33.567377 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:33.567657 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:33.568495 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:33.568888 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:33.570448 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbba9-3097-4f76-8c9f-76af667af54b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:33.583858 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 622/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:33.590395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:33.679495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:33.716282 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84025c2-eab7-4138-958e-88af33c336e3 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:33.760961 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23f20-d597-44d8-a656-079a56c10398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:33.761884 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23f20-d597-44d8-a656-079a56c10398 None admin] REQUEST_METHOD: `PUT` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:33.762169 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23f20-d597-44d8-a656-079a56c10398 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:33.762503 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23f20-d597-44d8-a656-079a56c10398 None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/4176a445c2524d408292b045cf6d6926/roles/93b7af6993a74b1193246c0f73576c5e` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:33.778666 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a23f20-d597-44d8-a656-079a56c10398 None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=4176a445c2524d408292b045cf6d6926, role_id=93b7af6993a74b1193246c0f73576c5e)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:33.780724 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a23f20-d597-44d8-a656-079a56c10398 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:33.795569 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 610/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:54:33 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/4176a445c2524d408292b045cf6d6926/roles/93b7af6993a74b1193246c0f73576c5e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:54:36.030035 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb456c-8767-413a-b44c-fed22674e57d None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:36.030627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb456c-8767-413a-b44c-fed22674e57d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:36.030627 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb456c-8767-413a-b44c-fed22674e57d None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:36.032283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 623/1233] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:36.038871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:36.039349 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:36.039458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:36.057924 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:36.059495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:36.131215 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 611/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:36.160271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb456c-8767-413a-b44c-fed22674e57d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:36.187036 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:36.269545 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb456c-8767-413a-b44c-fed22674e57d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:36.305452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:36.306400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:36.306684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:36.307027 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:36.319436 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:36.327684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:36.329054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:36.330215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 624/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Thu May 19 14:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:36.335759 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:36.389391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:36.450497 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d620a7-9461-4de4-9b1f-6b06dfbef392 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:36.488710 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:36.489843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:36.489843 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:36.490116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:36.490902 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] RBAC: Adding query filter params (name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:36.491221 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:36.492593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:36.501108 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 612/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Thu May 19 14:54:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:36.506744 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:36.600005 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:36.616208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db3031-9d65-4f72-b2e0-1959150aea5b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:36.653734 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:36.655192 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:36.655560 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:36.655978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:36.670518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:36.672101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:36.691371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:36.692547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:36.698408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:36.698408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:36.698408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:36.698408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:36.698408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 625/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:36.698773 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:36.813762 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea78fa-ec32-4925-a44f-978ace97d78f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:36.826555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:36.857188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:36.857782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:36.858069 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:36.858348 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:36.859116 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:36.859429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:36.860799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:36.874585 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 613/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:36.884535 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:37.002852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2011f-5275-4fef-894e-840fbb3a5a70 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:37.040056 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:37.040957 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:37.041241 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:37.041563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] PATH_INFO: `/v3/users/placement` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:37.045011 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:37.050373 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:37.052009 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:54:37.068028 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:37.069476 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:37.070872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 626/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:37.075384 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:37.186038 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcc799-6eba-4085-9242-5c552aa1c51d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:37.225146 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:37.225962 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:37.226255 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:37.226539 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:37.227558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:37.227878 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:37.229692 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:37.250743 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 614/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:54:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:37.256496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:37.368895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01134-d891-4747-be8a-59f5fc9ed4df None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:37.409253 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:37.409966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:37.410205 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:37.410484 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:37.477423 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:37.485707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:37.487165 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:37.606829 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 627/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:54:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:54:37.612767 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:37.645202 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:37.743797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e3e53-3bc7-4ec5-aac4-b4815d62dad5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:37.781822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:37.782702 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:37.783027 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:37.783344 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:37.795126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:37.798062 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:37.818500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:37.820231 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:37.821500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:37.821500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:37.821500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:37.821500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:37.821500 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 615/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:37.825850 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:37.939769 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:37.947641 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192286-be3f-4d57-813f-c8aff2564fa5 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:37.983335 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:37.984079 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:37.984435 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:37.984715 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:37.985534 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:37.985844 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:37.987402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:38.006025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 628/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:38.007072 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:38.098827 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:38.125978 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28366-2f6d-4a3f-810d-3f9fe01b40d5 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:38.166544 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:38.167392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:38.167732 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:38.168016 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:38.176294 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:38.177782 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:54:38.192176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:38.193467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:38.194719 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:38.198269 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 616/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:38.199230 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:38.307615 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3594-d5a0-466c-a4b8-bfb4f7882b1e None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:38.345879 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:38.346663 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:38.347062 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:38.347349 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:38.348292 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:38.348657 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:38.350384 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262210-ba25-446a-890e-1c17ff9ea21d None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:38.364334 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 629/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:38.370390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:38.485272 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde409-5dd2-434e-a89b-8a8edb06498e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:38.522665 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:38.523479 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:38.523829 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:38.524099 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:38.525081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] RBAC: Adding query filter params (role.id=93b7af6993a74b1193246c0f73576c5e, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=4176a445c2524d408292b045cf6d6926) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:38.525415 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:38.527130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b0b0a-f05b-4432-aad4-cf9d3c9225e1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:38.533804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 617/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:54:38 2022] GET /identity/v3/role_assignments?user.id=4176a445c2524d408292b045cf6d6926&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=93b7af6993a74b1193246c0f73576c5e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:40.915559 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660afd8-8a51-418f-875d-5db5ff379046 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:40.916135 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660afd8-8a51-418f-875d-5db5ff379046 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:40.916135 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660afd8-8a51-418f-875d-5db5ff379046 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:40.917526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 630/1247] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:40.923851 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660a34-b714-4060-bf10-632862c700da None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:40.924409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660a34-b714-4060-bf10-632862c700da None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:40.924409 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660a34-b714-4060-bf10-632862c700da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:40.930126 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:40.944047 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-cc660a34-b714-4060-bf10-632862c700da None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:40.945271 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-cc660a34-b714-4060-bf10-632862c700da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:41.034833 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 618/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:41.064853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660afd8-8a51-418f-875d-5db5ff379046 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:41.085657 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:41.180742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660afd8-8a51-418f-875d-5db5ff379046 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:41.220831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:41.221800 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:41.222185 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:41.222479 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:41.234299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:41.242224 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:41.248819 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:41.250408 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 631/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:41.251480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660a34-b714-4060-bf10-632862c700da None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:41.370881 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660a34-b714-4060-bf10-632862c700da None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:41.408546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:41.414182 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:41.415134 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:41.415434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:41.415895 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:41.416641 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:41.416957 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:41.418354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:41.427371 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 619/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:41.433091 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:41.524298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:41.550378 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68dd64-f3df-430e-9151-88b858461773 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:41.592961 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:41.593800 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:41.594254 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:41.594840 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:41.612487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:41.614846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:41.638025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:41.639200 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:41.640403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:41.640403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:41.640403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:41.640403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:41.640403 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 632/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:41.646367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:41.764434 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ff7-2289-4eab-81d7-81c033d9e8b1 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:41.803006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:41.803683 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:41.803971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:41.804252 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:41.804990 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:41.805298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:41.806669 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:41.820085 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 620/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:41.825856 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:41.951952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3946-3080-45d6-9428-9a82debedbf4 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:41.982753 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:41.991497 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:41.992309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:41.992594 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:41.992872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] PATH_INFO: `/v3/users/placement` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:42.000832 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:42.002299 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:54:42.017117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:42.018848 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:42.020900 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 633/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:42.024477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:42.083108 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:42.139066 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d22a-1a12-41c7-a422-58a73ce0cf97 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:42.182467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:42.183172 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:42.183458 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:42.183739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:42.184586 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:42.184893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:42.186374 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:42.203890 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 621/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:54:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:42.210065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:42.318216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fed27-efa0-489c-a379-32b49579ccda None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:42.360633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:42.361483 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:42.361779 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:42.362066 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:42.430215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:42.447290 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:42.448901 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:42.568101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 634/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:54:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:54:42.575241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:42.707818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3aba2-a430-4455-9412-cb317a61b40d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:42.725030 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:42.754238 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:42.755188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:42.755482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:42.755769 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:42.767233 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:42.768714 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:42.786996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:42.788167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:42.789286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:42.789286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:42.789286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:42.789286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:42.789286 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 622/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:42.794693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:42.903260 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:42.916967 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd790e7-8d7d-43bd-8f7a-bf36bdd4a710 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:42.956379 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:42.957453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:42.957720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:42.958181 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:42.959080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:42.959428 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:42.961264 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:42.982952 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 635/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:42.984449 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:43.109049 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79801d8-6b13-4e2d-811d-9ccec9c86d77 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:43.152133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:43.152954 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:43.154899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:43.154899 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:43.161589 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:43.163241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:54:43.184364 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:43.185763 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:43.192839 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 623/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:43.193558 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:43.322563 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000665-90e5-40db-8226-5c75941deb35 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:43.364999 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:43.365714 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:43.365989 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:43.366269 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] PATH_INFO: `/v3/projects` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:43.367132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:43.367453 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:43.368962 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb290-6fdd-47a9-9701-7a2da22818c7 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:43.389695 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 636/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:43.391174 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:43.425111 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:43.517508 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d439b-cb92-4e06-a667-5e3d6bd04b54 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:43.553333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:43.554017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:43.554307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:43.554591 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:43.555492 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=4176a445c2524d408292b045cf6d6926) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:43.555814 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:43.557279 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02fba-8c17-4731-bb53-b2de71658356 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:43.564224 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 624/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:54:43 2022] GET /identity/v3/role_assignments?user.id=4176a445c2524d408292b045cf6d6926&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=40636a8261d645b6a2041281c7044370 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:45.836426 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5f471-63eb-4860-994f-d2fd1fa4502d None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:45.837001 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5f471-63eb-4860-994f-d2fd1fa4502d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:45.837001 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5f471-63eb-4860-994f-d2fd1fa4502d None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:45.838406 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 637/1261] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:45.844731 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:45.845217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:45.845332 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:45.862130 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:45.863363 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:45.928985 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 625/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:45.952831 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5f471-63eb-4860-994f-d2fd1fa4502d None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:45.963882 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:46.055390 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5f471-63eb-4860-994f-d2fd1fa4502d None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:46.089195 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:46.089928 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:46.090215 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:46.090496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:46.100978 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:46.109365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:46.110707 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:46.112068 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 638/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:46.116549 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:46.135268 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:46.216756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593bee-3afe-467d-97fa-78bec3dfd33a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:46.249845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:46.250523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:46.250837 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:46.251128 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] PATH_INFO: `/v3/roles` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:46.251888 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] RBAC: Adding query filter params (name=admin) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:46.252205 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:46.253582 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:46.262429 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 626/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:46.268814 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:46.335070 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:46.368544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a881499-810f-434f-a287-b902cd330dbf None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:46.405389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:46.406187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:46.406474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:46.406756 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:46.417097 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:46.418578 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:46.437354 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:46.438705 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:46.440051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:46.440051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:46.440051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:46.440051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:46.440051 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 639/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:46.444789 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:46.527685 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:46.546624 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeccd97-13f6-4311-be1e-8cca8df15aac None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:46.581861 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:46.582535 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:46.582849 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:46.583139 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:46.583871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:46.584186 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:46.585565 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:46.597435 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 627/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:46.603163 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:46.732033 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926301-11f3-4e12-b663-2fd2b9ab7c11 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:46.756375 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:46.771578 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:46.772397 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:46.772682 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:46.772960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] PATH_INFO: `/v3/users/placement` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:46.787859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:46.790065 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:54:46.807485 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:46.808852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:46.810849 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:46.818150 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 640/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:46.824002 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:46.923065 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccd03d-8267-4c93-832a-89febecb178f None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:46.958427 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:46.959133 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:46.959553 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:46.960036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] PATH_INFO: `/v3/users` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:46.963934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:46.963934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:46.963934 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:46.972816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:46.984419 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 628/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:54:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:46.989995 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:47.089014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824b695-a5a0-4103-adc3-3e08cc80607c None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:47.121927 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:47.123315 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:47.123608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:47.123891 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:47.134188 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:47.135691 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:47.152531 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:47.154252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:47.155523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:47.155523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:47.155523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:47.155523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:47.155523 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 641/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:47.159914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:47.262335 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b4bfa-81cf-4c9c-a9ae-614c280c1c7a None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:47.296555 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:47.297228 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:47.297518 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:47.297804 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:47.298533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:47.298876 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:47.300273 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:47.311401 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 629/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:47.317022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:47.348948 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:47.417256 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f454c7-b222-4a6b-9b71-9dde3a790bf9 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:47.450693 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:47.451626 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:47.451919 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:47.452203 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:47.459147 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:47.460619 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:54:47.475474 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:47.476679 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:47.477971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 642/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:47.483217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:47.541137 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:47.583639 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c91499-1914-4ef8-a866-8e9d7d10b06d None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:47.616841 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:47.617502 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:47.617790 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:47.618073 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:47.618891 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:47.619210 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:47.620647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87341f1-d743-404a-b03b-664428604ae6 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:47.632499 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 630/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:47.639161 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:47.747221 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:47.758936 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50afb6-4389-41dc-945e-40779659727a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:47.804727 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5033e7-2e5b-4240-a529-526d856c4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:47.805958 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5033e7-2e5b-4240-a529-526d856c4d0c None admin] REQUEST_METHOD: `PUT` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:47.806360 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5033e7-2e5b-4240-a529-526d856c4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:47.806752 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5033e7-2e5b-4240-a529-526d856c4d0c None admin] PATH_INFO: `/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/4176a445c2524d408292b045cf6d6926/roles/40636a8261d645b6a2041281c7044370` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:47.809482 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5033e7-2e5b-4240-a529-526d856c4d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=24ee8ea604a74960b24ae9ea026ee3e5, user_id=4176a445c2524d408292b045cf6d6926, role_id=40636a8261d645b6a2041281c7044370)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:47.827270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5033e7-2e5b-4240-a529-526d856c4d0c None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:47.854472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 643/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Thu May 19 14:54:47 2022] PUT /identity/v3/projects/24ee8ea604a74960b24ae9ea026ee3e5/users/4176a445c2524d408292b045cf6d6926/roles/40636a8261d645b6a2041281c7044370 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:54:50.082488 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1adea-5383-405f-9db4-9d2a78229677 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.083000 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1adea-5383-405f-9db4-9d2a78229677 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.083118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1adea-5383-405f-9db4-9d2a78229677 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.084467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 631/1274] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:50.089634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.090119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.090219 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.107389 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:50.108583 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:50.173983 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 644/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:50.197877 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1adea-5383-405f-9db4-9d2a78229677 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:50.297307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1adea-5383-405f-9db4-9d2a78229677 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:50.314489 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:50.332020 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:50.332811 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.333100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.333387 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.343367 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:50.350996 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:50.352295 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:50.353421 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 632/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Thu May 19 14:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:50.358086 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:50.436259 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:50.455808 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a795d6-ff11-42fa-9f2a-f2df74957c55 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:50.488650 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:50.489310 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.489598 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.489876 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] PATH_INFO: `/v3/roles` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.490621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:50.490966 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:50.492348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:50.500798 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 645/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Thu May 19 14:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:50.506453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:50.605284 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a2d27-428d-4a34-bfb9-83215f956209 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:50.638410 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:50.639222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.639513 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.639797 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.650048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:50.651534 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:50.668217 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:50.670152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:50.671423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:50.671423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:50.671423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:50.671423 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:50.675648 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 633/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:50.676431 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:50.774248 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d31-551f-4279-a17b-efc9fc161410 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:50.807196 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:50.807859 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.808148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.808430 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] PATH_INFO: `/v3/domains` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.809155 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:50.810052 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:50.811581 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:50.823121 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 646/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:50.828799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:50.860034 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:50.930315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1624-389f-4fdf-86f1-704bb1cef81e None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:50.963043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:50.963836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:50.964123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:50.964405 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:50.972239 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:50.973682 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:54:50.988241 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:50.989487 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:50.991042 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 634/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:50.995101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:50.998873 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:51.093646 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e77c0-cc22-450e-a1d1-caf30d1e28cf None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:51.127667 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:51.128267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:51.128554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:51.128835 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] PATH_INFO: `/v3/users` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:51.129671 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:51.129985 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:51.131491 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:51.148088 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 647/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Thu May 19 14:54:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:51.154360 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:51.241483 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:51.251109 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555363c-5837-492a-b3da-8242862d02ce None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:51.283596 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:51.284240 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:51.284526 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:51.284807 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:51.353339 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:51.354844 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:51.439914 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:51.450893 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 635/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Thu May 19 14:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:54:51.457846 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:51.519443 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:51.557600 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c548de-b0df-4f31-9195-af21468b7469 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:51.591676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:51.592454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:51.592741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:51.593018 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:51.602774 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:51.604251 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:54:51.621343 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:51.622630 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:51.624139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:54:51.624139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:54:51.624139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:54:51.624139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:51.624139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 648/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Thu May 19 14:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:51.628236 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:51.731035 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d36ed3-17c0-47cd-adb7-9c4f27009aff None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:51.765015 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:51.765688 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:51.765983 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:51.766273 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] PATH_INFO: `/v3/domains` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:51.767036 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:51.767359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:51.768738 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:51.779928 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 636/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Thu May 19 14:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:51.785575 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:51.883720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7f51-9c4b-48d3-acb0-d9c84672064b None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:51.897930 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:51.917767 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:51.918557 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:51.918944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:51.919351 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:51.925783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:51.927283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:54:51.941344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application with Lock( May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:51.942511 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: ERROR keystone.server.flask.application May 19 14:54:51.943608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 649/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Thu May 19 14:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:51.948307 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:51.997581 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:52.047940 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f60dad-740c-4744-afbc-c9a0d8584194 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:52.080625 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:52.081529 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:52.081824 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:52.082105 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] PATH_INFO: `/v3/projects` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:52.082917 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:52.083234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:52.084655 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5423dd-79f6-4a7a-9080-fdc2e3387cdd None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:52.096437 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 637/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Thu May 19 14:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:52.102402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:52.200911 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1af95-f532-4daf-ab75-9e2d547a2b50 None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:52.233619 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:52.234264 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:52.234554 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:52.234862 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:52.235694 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] RBAC: Adding query filter params (role.id=40636a8261d645b6a2041281c7044370, scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5, user.id=4176a445c2524d408292b045cf6d6926) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:52.236014 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:52.237449 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1aea-abbf-415e-81b8-5cf542a1e3bc None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:52.243164 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 650/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Thu May 19 14:54:52 2022] GET /identity/v3/role_assignments?user.id=4176a445c2524d408292b045cf6d6926&scope.project.id=24ee8ea604a74960b24ae9ea026ee3e5&role.id=40636a8261d645b6a2041281c7044370 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:54.464359 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120878ec-85a1-477e-b379-47570f534fd9 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:54.464913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120878ec-85a1-477e-b379-47570f534fd9 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:54.464913 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120878ec-85a1-477e-b379-47570f534fd9 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:54.466859 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 638/1288] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:54.471954 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:54.472404 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:54.472516 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:54.489096 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:54.490309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:54.519454 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:54.556449 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 651/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:54.578747 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120878ec-85a1-477e-b379-47570f534fd9 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:54.686952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120878ec-85a1-477e-b379-47570f534fd9 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:54.699612 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:54.729482 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:54.730467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:54.730809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:54.731129 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:54.731932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:54.733315 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:54.745392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:54.747395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:54.748609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 639/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:54:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:54.753319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:54.849365 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8dd05-345a-465d-8018-8abc95d2aa8f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:54.883378 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:54.884043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:54.884326 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:54.884602 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:54.885309 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] RBAC: Adding query filter params (name=placement) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:54.885618 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:54.887019 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d6e6-575d-40cf-a422-30f2f7aa0731 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:54.892314 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 652/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:54:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:54.898014 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:54.995546 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608013b3-c687-4cbc-bc4f-190750f682ab None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:55.029439 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:55.030117 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:55.030410 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:55.030698 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] PATH_INFO: `/v3/services` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:55.031453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:55.031774 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:55.033152 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d045b-d854-4f4b-ace9-ae7c875299f2 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:55.037718 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 640/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:54:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:57.237350 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ead3b2-3d6d-4979-b257-c42f56a5cf1f None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:57.237895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ead3b2-3d6d-4979-b257-c42f56a5cf1f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:57.237895 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ead3b2-3d6d-4979-b257-c42f56a5cf1f None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:57.239340 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 653/1293] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:57.244573 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7f229-7b68-424c-b4f7-a11416fe0fd0 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:57.244984 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7f229-7b68-424c-b4f7-a11416fe0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:57.245143 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7f229-7b68-424c-b4f7-a11416fe0fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:57.261799 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-f0b7f229-7b68-424c-b4f7-a11416fe0fd0 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:57.263131 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-f0b7f229-7b68-424c-b4f7-a11416fe0fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:57.292424 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:57.330167 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 641/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:57.354249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ead3b2-3d6d-4979-b257-c42f56a5cf1f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:57.385945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:57.458656 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ead3b2-3d6d-4979-b257-c42f56a5cf1f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:57.492298 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ec6d-ddb6-401d-8792-136a439ff7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:57.492960 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ec6d-ddb6-401d-8792-136a439ff7af None admin] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:57.493249 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ec6d-ddb6-401d-8792-136a439ff7af None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:57.493529 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ec6d-ddb6-401d-8792-136a439ff7af None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:57.494261 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ec6d-ddb6-401d-8792-136a439ff7af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:57.495676 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ec6d-ddb6-401d-8792-136a439ff7af None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:57.508628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 654/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Thu May 19 14:54:57 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:54:59.726861 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343108-6b37-4636-8a6a-dfec51d4de9f None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:59.727443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343108-6b37-4636-8a6a-dfec51d4de9f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:59.727443 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343108-6b37-4636-8a6a-dfec51d4de9f None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:59.728801 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 642/1296] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:59.734515 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:59.734944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:59.735136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:59.752187 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:59.753374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:59.825487 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 655/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:54:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:59.848017 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343108-6b37-4636-8a6a-dfec51d4de9f None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:59.947275 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343108-6b37-4636-8a6a-dfec51d4de9f None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:59.980392 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:59.981667 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:59.981952 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:59.982229 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] PATH_INFO: `/v3/services/placement` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:59.982910 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:59.984278 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:59.995716 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:59.997068 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:54:59.999604 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 643/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:54:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:00.003295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:00.021266 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:00.100731 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db34c2-b76e-4c22-9762-465f7de1105a None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:00.133649 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:00.134312 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:00.134599 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:00.134910 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:00.135621 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] RBAC: Adding query filter params (name=placement) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:00.135935 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:00.137371 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:00.142417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 656/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:55:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:00.148536 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:00.180590 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:00.248828 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3c5de-d48e-48c0-a763-2a8875c33f45 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:00.281457 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:00.282104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:00.282391 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:00.282671 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:00.283490 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] RBAC: Adding query filter params (interface=public, service_id=baa81990d5504d8aa614202b75a8e5a2, region_id=RegionOne) {{(pid=270180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:00.283806 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:00.285159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0875-3c42-489e-8c81-21ce1a5cf07e None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:00.290108 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 644/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Thu May 19 14:55:00 2022] GET /identity/v3/endpoints?service_id=baa81990d5504d8aa614202b75a8e5a2&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:00.296251 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:00.374333 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:00.393271 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19884271-a645-4d83-ae45-aa105f4e418a None admin] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:00.426524 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86fdd-e8dd-4bf1-a42e-9252b4c34db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:00.427223 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86fdd-e8dd-4bf1-a42e-9252b4c34db3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:00.427518 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86fdd-e8dd-4bf1-a42e-9252b4c34db3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:00.427805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86fdd-e8dd-4bf1-a42e-9252b4c34db3 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:00.428490 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86fdd-e8dd-4bf1-a42e-9252b4c34db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:00.429870 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86fdd-e8dd-4bf1-a42e-9252b4c34db3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:00.436634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 657/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Thu May 19 14:55:00 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:55:02.653822 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f040d-8ea4-4146-aa0d-79023e492a86 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:02.654382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f040d-8ea4-4146-aa0d-79023e492a86 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:02.654382 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f040d-8ea4-4146-aa0d-79023e492a86 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:02.655805 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 645/1302] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:55:02.661439 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:02.661853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:02.661982 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:02.679289 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:02.680494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:02.744786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 658/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:55:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:02.768388 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f040d-8ea4-4146-aa0d-79023e492a86 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:02.863713 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:02.870871 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f040d-8ea4-4146-aa0d-79023e492a86 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:02.905280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:02.906008 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:02.906293 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:02.906574 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] PATH_INFO: `/v3/services/placement` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:02.907256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:02.908619 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:02.920672 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:02.921911 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application with Lock( May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: ERROR keystone.server.flask.application May 19 14:55:02.922991 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 646/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Thu May 19 14:55:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:02.928117 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:03.002308 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:03.025410 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027781-72d8-4cde-be58-630533a1a771 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:03.061783 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:03.062459 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:03.062750 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:03.063069 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] PATH_INFO: `/v3/services` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:03.063789 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=270181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:03.064105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:03.065504 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379106c0-836b-4a9b-b0b3-e0c874f0acf3 None admin] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:03.070668 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 659/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Thu May 19 14:55:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:03.076605 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:03.176048 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a18b5-2efc-4394-a00c-f2f4c9acec66 None admin] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:03.208256 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895dab-b2b2-4f1f-b1d3-582ffd3614f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3cc6fae8b64bde852a1c9bdb227ae0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:03.208907 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895dab-b2b2-4f1f-b1d3-582ffd3614f7 None admin] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:03.209195 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895dab-b2b2-4f1f-b1d3-582ffd3614f7 None admin] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:03.209477 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895dab-b2b2-4f1f-b1d3-582ffd3614f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:03.210218 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895dab-b2b2-4f1f-b1d3-582ffd3614f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:03.211614 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895dab-b2b2-4f1f-b1d3-582ffd3614f7 None admin] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:03.230006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 647/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Thu May 19 14:55:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:55:13.068257 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=30 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:13.225776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:08.955684 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43c4e-f699-402e-958a-6bf809452889 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:08.956288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43c4e-f699-402e-958a-6bf809452889 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:08.956288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43c4e-f699-402e-958a-6bf809452889 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:08.957921 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 660/1307] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:08.963615 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcff6be-5690-4c20-8c33-1c06ebf7393b None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:08.964083 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcff6be-5690-4c20-8c33-1c06ebf7393b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:08.964189 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcff6be-5690-4c20-8c33-1c06ebf7393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:09.096756 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-8fcff6be-5690-4c20-8c33-1c06ebf7393b None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:09.097884 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-8fcff6be-5690-4c20-8c33-1c06ebf7393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:09.241792 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 648/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:09.304884 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc13743-db2c-46f0-a96f-cde9610710d2 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:09.305191 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc13743-db2c-46f0-a96f-cde9610710d2 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:09.305512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc13743-db2c-46f0-a96f-cde9610710d2 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:09.307228 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 661/1309] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:09.320396 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c75d4f-1789-4c7b-8c11-1efdee017711 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:09.321289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c75d4f-1789-4c7b-8c11-1efdee017711 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:09.321547 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c75d4f-1789-4c7b-8c11-1efdee017711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:09.489165 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-16c75d4f-1789-4c7b-8c11-1efdee017711 None None] MFA Rules not processed for user `9858c1681f0e4afa9270642c5b22122f`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:09.491055 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-16c75d4f-1789-4c7b-8c11-1efdee017711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:09.551114 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:09.667480 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 649/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:09.668325 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc13743-db2c-46f0-a96f-cde9610710d2 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:09.670127 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2dc13743-db2c-46f0-a96f-cde9610710d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:09.894366 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc13743-db2c-46f0-a96f-cde9610710d2 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:10.019417 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:10.020106 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:10.020400 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:10.020743 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:10.022442 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:10.084720 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:10.193132 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:10.194833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2b2c7-e79b-4fd8-b183-d7ccde18dc64 service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:10.253268 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 662/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:12.999519 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140eec-10f7-457e-866c-b518b3ba13d0 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:13.000046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140eec-10f7-457e-866c-b518b3ba13d0 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:13.000046 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140eec-10f7-457e-866c-b518b3ba13d0 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:13.003191 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 650/1312] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:13.007359 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249fec-1d77-45bd-a56a-0c745978aa75 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:13.008795 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249fec-1d77-45bd-a56a-0c745978aa75 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:13.009319 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249fec-1d77-45bd-a56a-0c745978aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:13.098252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-ef249fec-1d77-45bd-a56a-0c745978aa75 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:13.099680 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-ef249fec-1d77-45bd-a56a-0c745978aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:13.203539 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 663/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:13.244175 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69140eec-10f7-457e-866c-b518b3ba13d0 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:13.246155 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-69140eec-10f7-457e-866c-b518b3ba13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:13.370376 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69140eec-10f7-457e-866c-b518b3ba13d0 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:13.457619 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:13.460647 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:13.462183 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:13.462593 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:13.463009 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:13.465104 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:13.598249 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:13.599860 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d60547-a400-4e54-a187-b9cfe1880a40 service neutron] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:13.631266 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 651/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:16.229625 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffade7-2d05-490f-a73d-986e7c853ff9 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:16.230169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffade7-2d05-490f-a73d-986e7c853ff9 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:16.230169 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffade7-2d05-490f-a73d-986e7c853ff9 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:16.231608 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 664/1315] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:16.236864 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e51c1-c67d-44f2-a69e-d62909453bbf None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:16.237303 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e51c1-c67d-44f2-a69e-d62909453bbf None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:16.237425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e51c1-c67d-44f2-a69e-d62909453bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:16.302656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-940e51c1-c67d-44f2-a69e-d62909453bbf None None] MFA Rules not processed for user `86a02799f2554ebd84af7b73acccf48f`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:16.303855 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-940e51c1-c67d-44f2-a69e-d62909453bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:16.357159 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:16.402896 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 652/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:16.442262 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffade7-2d05-490f-a73d-986e7c853ff9 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:16.443837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-adffade7-2d05-490f-a73d-986e7c853ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:16.453822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:16.547855 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffade7-2d05-490f-a73d-986e7c853ff9 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:16.620525 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:16.621111 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:16.621402 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:16.621685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:16.623385 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:16.685872 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:16.733592 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:16.735083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5f7d2-19d4-481b-8923-f4aacffcec9f service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:16.752833 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 665/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:19.506738 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ac52-3215-4753-8f79-d0b48a7531fc None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:19.507222 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ac52-3215-4753-8f79-d0b48a7531fc None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:19.507426 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ac52-3215-4753-8f79-d0b48a7531fc None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:19.508754 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 653/1318] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:19.514113 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c303d0-f1c3-468e-b562-17c91e8d187d None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:19.514547 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c303d0-f1c3-468e-b562-17c91e8d187d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:19.514675 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c303d0-f1c3-468e-b562-17c91e8d187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:19.579664 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-14c303d0-f1c3-468e-b562-17c91e8d187d None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:19.580877 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-14c303d0-f1c3-468e-b562-17c91e8d187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:19.677537 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 666/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:19.732118 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3592-9285-444a-b04c-dc4291a61438 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:19.732410 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3592-9285-444a-b04c-dc4291a61438 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:19.732696 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3592-9285-444a-b04c-dc4291a61438 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:19.734081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 654/1320] 10.222.0.71 () {54 vars in 964 bytes} [Thu May 19 14:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:19.740025 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0d3cd-8a18-4bf0-b5f3-3061a09c483f None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:19.740322 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0d3cd-8a18-4bf0-b5f3-3061a09c483f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:19.740605 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0d3cd-8a18-4bf0-b5f3-3061a09c483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:19.761374 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:19.815072 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-10a0d3cd-8a18-4bf0-b5f3-3061a09c483f None None] MFA Rules not processed for user `9858c1681f0e4afa9270642c5b22122f`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:19.816274 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-10a0d3cd-8a18-4bf0-b5f3-3061a09c483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:19.891542 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 667/1321] 10.222.0.71 () {58 vars in 1061 bytes} [Thu May 19 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:19.901283 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e3592-9285-444a-b04c-dc4291a61438 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:19.902921 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-d23e3592-9285-444a-b04c-dc4291a61438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:20.016866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e3592-9285-444a-b04c-dc4291a61438 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:20.089749 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:20.090398 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:20.090686 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:20.090999 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:20.092628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:20.099976 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:20.201085 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:20.202354 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e201a-6321-4309-8b71-06255cc0c0e8 service neutron] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:20.220173 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 655/1322] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:23.584943 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ff35-7c6c-4ab4-a65f-61ffe1ec10a0 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:23.585526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ff35-7c6c-4ab4-a65f-61ffe1ec10a0 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:23.585669 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ff35-7c6c-4ab4-a65f-61ffe1ec10a0 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:23.587718 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 668/1323] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:23.592826 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4c21-7c64-4b38-ac57-149fe24c2660 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:23.593288 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4c21-7c64-4b38-ac57-149fe24c2660 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:23.593395 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4c21-7c64-4b38-ac57-149fe24c2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:23.660079 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-9c3d4c21-7c64-4b38-ac57-149fe24c2660 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:23.661290 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-9c3d4c21-7c64-4b38-ac57-149fe24c2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:23.720176 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:23.759865 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 656/1324] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:56:23.795564 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ff35-7c6c-4ab4-a65f-61ffe1ec10a0 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:23.797139 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-a3a2ff35-7c6c-4ab4-a65f-61ffe1ec10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:23.903925 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ff35-7c6c-4ab4-a65f-61ffe1ec10a0 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:23.916708 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:23.979911 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:23.980574 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:23.980860 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:23.981138 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:23.982802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:24.101044 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:24.103216 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed4ea5-685f-4076-b549-4baff16d44d5 service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:24.121401 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 669/1325] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:26.453466 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01339-1b1e-44d6-88c6-c573793433cd None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:26.454031 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01339-1b1e-44d6-88c6-c573793433cd None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:26.454031 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01339-1b1e-44d6-88c6-c573793433cd None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:26.455461 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 657/1326] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:26.461381 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a43c-915c-4f25-a157-70cc813d60c5 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:26.461865 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a43c-915c-4f25-a157-70cc813d60c5 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:26.462077 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a43c-915c-4f25-a157-70cc813d60c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:26.512023 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:26.531838 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-3e20a43c-915c-4f25-a157-70cc813d60c5 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:26.533105 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-3e20a43c-915c-4f25-a157-70cc813d60c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:26.636890 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 670/1327] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:26.674609 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01339-1b1e-44d6-88c6-c573793433cd None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:26.676206 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-8bc01339-1b1e-44d6-88c6-c573793433cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:26.782471 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01339-1b1e-44d6-88c6-c573793433cd None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:26.857412 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:26.858077 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:26.858368 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:26.858660 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:26.860340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:26.878175 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:26.972404 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:26.973863 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890d855-023a-4562-b42a-6d1e4abd67f5 service neutron] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:26.992805 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 658/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:29.271362 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad181d5-54b3-48d7-b743-d1abbb3ab0b7 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:29.271915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad181d5-54b3-48d7-b743-d1abbb3ab0b7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:29.271915 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad181d5-54b3-48d7-b743-d1abbb3ab0b7 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:29.273252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 671/1329] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:29.278451 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc562f-4875-46d5-a6ea-95191fd7ab19 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:29.278896 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc562f-4875-46d5-a6ea-95191fd7ab19 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:29.279052 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc562f-4875-46d5-a6ea-95191fd7ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:29.343818 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-6dcc562f-4875-46d5-a6ea-95191fd7ab19 None None] MFA Rules not processed for user `86a02799f2554ebd84af7b73acccf48f`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:29.345035 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-6dcc562f-4875-46d5-a6ea-95191fd7ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:29.413874 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:29.446192 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 659/1330] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:29.482741 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad181d5-54b3-48d7-b743-d1abbb3ab0b7 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:29.484348 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-8ad181d5-54b3-48d7-b743-d1abbb3ab0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:29.592496 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad181d5-54b3-48d7-b743-d1abbb3ab0b7 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:29.612894 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:29.672080 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:29.672758 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:29.673054 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:29.673344 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:29.675076 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:29.785777 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:29.787208 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6f526-eff5-40b3-9ac2-9f52db196342 service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:29.808818 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 672/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:32.302705 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e0f4c-45ea-4392-a514-ef44f1945db9 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:32.303280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e0f4c-45ea-4392-a514-ef44f1945db9 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:32.303280 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e0f4c-45ea-4392-a514-ef44f1945db9 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:32.305132 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 660/1332] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:32.310633 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90a22-25c3-461f-b4aa-09fa3ae1d708 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:32.311083 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90a22-25c3-461f-b4aa-09fa3ae1d708 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:32.311276 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90a22-25c3-461f-b4aa-09fa3ae1d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:32.373031 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:32.376042 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-5ce90a22-25c3-461f-b4aa-09fa3ae1d708 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:32.377788 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-5ce90a22-25c3-461f-b4aa-09fa3ae1d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:32.473288 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 673/1333] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:32.509809 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e0f4c-45ea-4392-a514-ef44f1945db9 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:32.511390 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-0a3e0f4c-45ea-4392-a514-ef44f1945db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:32.613904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e0f4c-45ea-4392-a514-ef44f1945db9 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:32.686736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:32.687425 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:32.687714 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:32.687994 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:32.689643 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:32.718289 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:32.799170 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:32.800616 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d274d-8029-449b-a261-488a7bf02760 service neutron] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:32.818340 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 661/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:35.067946 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5b88-3ec7-44fb-bc80-42ca823ae74f None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:35.068442 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5b88-3ec7-44fb-bc80-42ca823ae74f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:35.068544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5b88-3ec7-44fb-bc80-42ca823ae74f None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:35.070579 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 674/1335] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:35.075742 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0aaa-1fd9-479d-91bd-384b041d2619 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:35.076188 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0aaa-1fd9-479d-91bd-384b041d2619 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:35.076339 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0aaa-1fd9-479d-91bd-384b041d2619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:35.140470 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-cbdf0aaa-1fd9-479d-91bd-384b041d2619 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:35.141693 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-cbdf0aaa-1fd9-479d-91bd-384b041d2619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:35.216436 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:35.238595 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 662/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:35.278670 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c5b88-3ec7-44fb-bc80-42ca823ae74f None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:35.280278 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-094c5b88-3ec7-44fb-bc80-42ca823ae74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:35.382944 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c5b88-3ec7-44fb-bc80-42ca823ae74f None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:35.415153 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:35.462297 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:35.462998 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:35.463286 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:35.463567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:35.465226 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:35.573330 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:35.574724 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5f916-f96c-40a7-93d6-9c7be3547438 service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:35.593567 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 675/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:38.223615 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfa102-3c45-4b58-80d8-c2b8b54cd0e2 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:38.224247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfa102-3c45-4b58-80d8-c2b8b54cd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:38.224247 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfa102-3c45-4b58-80d8-c2b8b54cd0e2 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:38.225586 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 663/1338] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:38.231287 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee03-7e91-45c4-822a-6da698b20676 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:38.231853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee03-7e91-45c4-822a-6da698b20676 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:38.231853 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee03-7e91-45c4-822a-6da698b20676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:38.296463 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-f8b3ee03-7e91-45c4-822a-6da698b20676 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:38.297611 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-f8b3ee03-7e91-45c4-822a-6da698b20676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:38.306420 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:38.394119 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 676/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:38.429958 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfa102-3c45-4b58-80d8-c2b8b54cd0e2 None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:38.431527 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-fbbfa102-3c45-4b58-80d8-c2b8b54cd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:38.535201 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfa102-3c45-4b58-80d8-c2b8b54cd0e2 None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:38.608430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:38.609006 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:38.609291 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:38.609571 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:38.611227 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:38.646317 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:38.730150 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:38.731654 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a642-870d-49ee-943c-a1f36b68885c service neutron] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:38.750486 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 664/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 14:56:42.947486 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934799e-3e9d-4dd8-98a7-f581028b01c4 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:42.948050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934799e-3e9d-4dd8-98a7-f581028b01c4 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:42.948050 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934799e-3e9d-4dd8-98a7-f581028b01c4 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:42.949651 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 677/1341] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:42.954865 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ba08b-36f3-4642-96a8-2d6c208cbf1a None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:42.955330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ba08b-36f3-4642-96a8-2d6c208cbf1a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:42.955453 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ba08b-36f3-4642-96a8-2d6c208cbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:43.026467 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-446ba08b-36f3-4642-96a8-2d6c208cbf1a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:43.027711 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-446ba08b-36f3-4642-96a8-2d6c208cbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:43.118043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=100 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:43.131081 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 665/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:56:43.171805 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934799e-3e9d-4dd8-98a7-f581028b01c4 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:43.174101 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-4934799e-3e9d-4dd8-98a7-f581028b01c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:43.273438 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934799e-3e9d-4dd8-98a7-f581028b01c4 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:43.277043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aebd4e-742e-4cde-b9db-d09803cba7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:43.277702 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebd4e-742e-4cde-b9db-d09803cba7af service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:43.277997 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebd4e-742e-4cde-b9db-d09803cba7af service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:43.278283 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebd4e-742e-4cde-b9db-d09803cba7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:43.287701 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aebd4e-742e-4cde-b9db-d09803cba7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:43.289190 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aebd4e-742e-4cde-b9db-d09803cba7af service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:43.298918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 678/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:46.316202 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a8e18-adb3-41f3-b094-a77b3d70294a None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:46.316776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a8e18-adb3-41f3-b094-a77b3d70294a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:46.316776 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a8e18-adb3-41f3-b094-a77b3d70294a None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:46.318316 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 666/1344] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:46.324212 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb5a3-3d36-4a1d-bba2-235874a9fedc None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:46.324685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb5a3-3d36-4a1d-bba2-235874a9fedc None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:46.324801 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb5a3-3d36-4a1d-bba2-235874a9fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:46.353356 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-53bdb5a3-3d36-4a1d-bba2-235874a9fedc None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:46.354577 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-53bdb5a3-3d36-4a1d-bba2-235874a9fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:46.382431 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:46.434313 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 679/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:56:46.472373 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a8e18-adb3-41f3-b094-a77b3d70294a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:46.483346 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a8e18-adb3-41f3-b094-a77b3d70294a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:46.486869 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167ac5-41e1-49b6-b932-ccbaf84425b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:46.487523 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167ac5-41e1-49b6-b932-ccbaf84425b8 service neutron] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:46.487813 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167ac5-41e1-49b6-b932-ccbaf84425b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:46.488100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167ac5-41e1-49b6-b932-ccbaf84425b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:46.497903 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167ac5-41e1-49b6-b932-ccbaf84425b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:46.499386 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167ac5-41e1-49b6-b932-ccbaf84425b8 service neutron] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:46.509845 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 667/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:50.944002 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093007d2-75c6-4b52-9845-0e662bf7799e None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:50.944566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093007d2-75c6-4b52-9845-0e662bf7799e None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:50.944737 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093007d2-75c6-4b52-9845-0e662bf7799e None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:50.946211 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 680/1347] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:50.951866 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7422-ddb5-46a6-ac07-9fe1d29482c5 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:50.952258 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7422-ddb5-46a6-ac07-9fe1d29482c5 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:50.952431 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7422-ddb5-46a6-ac07-9fe1d29482c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:50.970679 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-af7c7422-ddb5-46a6-ac07-9fe1d29482c5 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:50.971918 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-af7c7422-ddb5-46a6-ac07-9fe1d29482c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:50.980254 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 668/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:51.017395 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093007d2-75c6-4b52-9845-0e662bf7799e None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:51.028624 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093007d2-75c6-4b52-9845-0e662bf7799e None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:51.032267 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84db2-73f2-4866-b78c-07ac170579b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858c1681f0e4afa9270642c5b22122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:51.032918 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84db2-73f2-4866-b78c-07ac170579b2 service neutron] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:51.033209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84db2-73f2-4866-b78c-07ac170579b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:51.033494 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84db2-73f2-4866-b78c-07ac170579b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:51.043528 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e84db2-73f2-4866-b78c-07ac170579b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:51.045108 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e84db2-73f2-4866-b78c-07ac170579b2 service neutron] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:51.054710 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 681/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:56.579937 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f102a2-2630-4816-b2ec-b2ee51df51e2 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:56.580816 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f102a2-2630-4816-b2ec-b2ee51df51e2 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:56.581649 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f102a2-2630-4816-b2ec-b2ee51df51e2 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:56.583234 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 669/1350] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:56.588785 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dacdf-4fb5-4de9-87f5-6262dba67d7f None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:56.589206 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dacdf-4fb5-4de9-87f5-6262dba67d7f None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:56.589561 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dacdf-4fb5-4de9-87f5-6262dba67d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:56.665973 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-310dacdf-4fb5-4de9-87f5-6262dba67d7f None None] MFA Rules not processed for user `4176a445c2524d408292b045cf6d6926`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:56.667721 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-310dacdf-4fb5-4de9-87f5-6262dba67d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:56.761991 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 682/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:00.965495 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=13 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:01.270533 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429e1b4-1d05-4f5b-91f5-a9867630cf0b None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:01.271107 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429e1b4-1d05-4f5b-91f5-a9867630cf0b None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:01.271960 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429e1b4-1d05-4f5b-91f5-a9867630cf0b None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:01.273542 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 670/1352] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:01.279233 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8d2f8-8e2b-461a-917a-686193d3cfd1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:01.279742 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8d2f8-8e2b-461a-917a-686193d3cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:01.279837 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8d2f8-8e2b-461a-917a-686193d3cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:01.298825 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-baa8d2f8-8e2b-461a-917a-686193d3cfd1 None None] MFA Rules not processed for user `4176a445c2524d408292b045cf6d6926`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:01.300057 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-baa8d2f8-8e2b-461a-917a-686193d3cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:01.309316 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 683/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:02.794403 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335bc17-a7cf-4fee-80ba-94b14bd21893 None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:02.794971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335bc17-a7cf-4fee-80ba-94b14bd21893 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:02.794971 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335bc17-a7cf-4fee-80ba-94b14bd21893 None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:02.796558 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 671/1354] 10.222.0.71 () {54 vars in 921 bytes} [Thu May 19 14:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:02.801361 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f795ea-988e-43b7-8e9a-5ed7817e47a1 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:02.801802 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f795ea-988e-43b7-8e9a-5ed7817e47a1 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:02.801959 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f795ea-988e-43b7-8e9a-5ed7817e47a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:02.820645 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-70f795ea-988e-43b7-8e9a-5ed7817e47a1 None None] MFA Rules not processed for user `4176a445c2524d408292b045cf6d6926`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:02.821852 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-70f795ea-988e-43b7-8e9a-5ed7817e47a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:02.830903 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 684/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Thu May 19 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:57:06.785298 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad24c-f935-4599-abc7-007d5ba8fe2f None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:06.786088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad24c-f935-4599-abc7-007d5ba8fe2f None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:06.786088 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad24c-f935-4599-abc7-007d5ba8fe2f None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:06.790043 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 672/1356] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:57:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:06.793786 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925284e7-30cf-4811-bf00-89fce0f6bf36 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:06.794295 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925284e7-30cf-4811-bf00-89fce0f6bf36 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:06.794409 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925284e7-30cf-4811-bf00-89fce0f6bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:06.812422 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-925284e7-30cf-4811-bf00-89fce0f6bf36 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:06.813634 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-925284e7-30cf-4811-bf00-89fce0f6bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:06.821632 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 685/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:06.880630 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c693-4792-4d98-81fd-9e614553c1cc None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:06.881430 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c693-4792-4d98-81fd-9e614553c1cc None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:06.881969 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c693-4792-4d98-81fd-9e614553c1cc None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:06.884005 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 673/1358] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:06.902270 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e12f7-7046-458b-bbb0-3b277b5128f7 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:06.902945 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e12f7-7046-458b-bbb0-3b277b5128f7 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:06.903472 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e12f7-7046-458b-bbb0-3b277b5128f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:06.947706 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=100 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:06.956553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-b87e12f7-7046-458b-bbb0-3b277b5128f7 None None] MFA Rules not processed for user `8088e85aab0b4adcb6c53d99a531515c`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:06.957754 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-b87e12f7-7046-458b-bbb0-3b277b5128f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:07.073544 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 686/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:07.081982 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3c693-4792-4d98-81fd-9e614553c1cc None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:07.097551 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3c693-4792-4d98-81fd-9e614553c1cc None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:07.103657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307fbb0-f037-4254-a817-fe940f32b4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8088e85aab0b4adcb6c53d99a531515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:07.104524 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307fbb0-f037-4254-a817-fe940f32b4e8 service nova] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:07.104975 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307fbb0-f037-4254-a817-fe940f32b4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:07.105444 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307fbb0-f037-4254-a817-fe940f32b4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:07.115184 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307fbb0-f037-4254-a817-fe940f32b4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:07.116800 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307fbb0-f037-4254-a817-fe940f32b4e8 service nova] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:07.126611 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 674/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:09.567095 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048ac84-10f0-4579-8cf5-311da9e6fb44 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:09.567615 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048ac84-10f0-4579-8cf5-311da9e6fb44 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:09.567735 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048ac84-10f0-4579-8cf5-311da9e6fb44 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:09.569136 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 687/1361] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:09.574512 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8060-56bc-4d2a-b5d7-d41070c1d446 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:09.575021 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8060-56bc-4d2a-b5d7-d41070c1d446 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:09.575131 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8060-56bc-4d2a-b5d7-d41070c1d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:09.593697 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-6a7d8060-56bc-4d2a-b5d7-d41070c1d446 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:09.595120 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-6a7d8060-56bc-4d2a-b5d7-d41070c1d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:09.603715 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 675/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:09.648553 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048ac84-10f0-4579-8cf5-311da9e6fb44 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:09.664441 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048ac84-10f0-4579-8cf5-311da9e6fb44 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:09.670452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa7c25-3888-43fc-b9be-ba63626ab257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8088e85aab0b4adcb6c53d99a531515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:09.671293 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa7c25-3888-43fc-b9be-ba63626ab257 service nova] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:09.671566 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa7c25-3888-43fc-b9be-ba63626ab257 service nova] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:09.671839 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa7c25-3888-43fc-b9be-ba63626ab257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:09.681003 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa7c25-3888-43fc-b9be-ba63626ab257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:09.682648 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa7c25-3888-43fc-b9be-ba63626ab257 service nova] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:09.692826 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 688/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:12.263657 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60712314-30f9-45a8-8185-bb385129b71e None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:12.264245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60712314-30f9-45a8-8185-bb385129b71e None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:12.264245 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60712314-30f9-45a8-8185-bb385129b71e None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:12.266011 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 676/1364] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:12.271956 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498ad5-d7a5-467a-b0d6-b61c78d2483a None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:12.272526 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498ad5-d7a5-467a-b0d6-b61c78d2483a None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:12.272628 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498ad5-d7a5-467a-b0d6-b61c78d2483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:12.292134 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-c1498ad5-d7a5-467a-b0d6-b61c78d2483a None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:12.293478 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-c1498ad5-d7a5-467a-b0d6-b61c78d2483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:12.302455 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 689/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:12.352166 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff9a9b-35f8-4f47-8db5-5eca077f5d8a None None] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:12.352606 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff9a9b-35f8-4f47-8db5-5eca077f5d8a None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:12.352998 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff9a9b-35f8-4f47-8db5-5eca077f5d8a None None] PATH_INFO: `/` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:12.354739 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 677/1366] 10.222.0.71 () {54 vars in 961 bytes} [Thu May 19 14:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:12.360584 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ec9e-014b-4c2f-82af-60fddcf4b877 None None] REQUEST_METHOD: `POST` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:12.361022 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ec9e-014b-4c2f-82af-60fddcf4b877 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:12.361411 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ec9e-014b-4c2f-82af-60fddcf4b877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:12.381017 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.auth.core [None req-2bc6ec9e-014b-4c2f-82af-60fddcf4b877 None None] MFA Rules not processed for user `8088e85aab0b4adcb6c53d99a531515c`. Rule list: `[]` (Enabled: `True`). {{(pid=270181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:12.382364 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.fernet_utils [None req-2bc6ec9e-014b-4c2f-82af-60fddcf4b877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:12.392282 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 690/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Thu May 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:12.400330 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff9a9b-35f8-4f47-8db5-5eca077f5d8a None None] Authenticating user token {{(pid=270180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:12.416972 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff9a9b-35f8-4f47-8db5-5eca077f5d8a None None] Validating token access rules against request {{(pid=270180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:12.422965 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6bea-2ff3-4927-bbfa-c228cdab3e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8088e85aab0b4adcb6c53d99a531515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:12.423728 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6bea-2ff3-4927-bbfa-c228cdab3e9e service nova] REQUEST_METHOD: `GET` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:12.424121 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6bea-2ff3-4927-bbfa-c228cdab3e9e service nova] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:12.424524 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6bea-2ff3-4927-bbfa-c228cdab3e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:12.433932 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca6bea-2ff3-4927-bbfa-c228cdab3e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:12.435677 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca6bea-2ff3-4927-bbfa-c228cdab3e9e service nova] RBAC: Authorization granted {{(pid=270180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:12.445736 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 678/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:13.395273 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cc878-d2be-49cf-a0ec-2a3e2810099d None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:13.396337 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cc878-d2be-49cf-a0ec-2a3e2810099d None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:13.396512 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cc878-d2be-49cf-a0ec-2a3e2810099d None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:13.398433 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 691/1369] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:13.404123 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b620-4a56-41c8-a5cc-9571da0e0115 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:13.404628 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b620-4a56-41c8-a5cc-9571da0e0115 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:13.404836 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b620-4a56-41c8-a5cc-9571da0e0115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:13.424656 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-85f5b620-4a56-41c8-a5cc-9571da0e0115 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:13.426075 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-85f5b620-4a56-41c8-a5cc-9571da0e0115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:13.435321 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 679/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:14.742162 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecce378-4965-4084-83c1-590eb487c2d8 None None] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:14.742732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecce378-4965-4084-83c1-590eb487c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:14.742732 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecce378-4965-4084-83c1-590eb487c2d8 None None] PATH_INFO: `/` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:14.744148 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 692/1371] 10.222.0.71 () {54 vars in 926 bytes} [Thu May 19 14:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:14.749333 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67665d-18a2-4558-9884-2af25ad5bb62 None None] REQUEST_METHOD: `POST` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:14.749750 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67665d-18a2-4558-9884-2af25ad5bb62 None None] SCRIPT_NAME: `/identity` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:14.749904 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67665d-18a2-4558-9884-2af25ad5bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:14.767548 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.auth.core [None req-eb67665d-18a2-4558-9884-2af25ad5bb62 None None] MFA Rules not processed for user `5c3cc6fae8b64bde852a1c9bdb227ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=270180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:14.768748 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG keystone.common.fernet_utils [None req-eb67665d-18a2-4558-9884-2af25ad5bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:14.776803 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: [pid: 270180|app: 0|req: 680/1372] 10.222.0.71 () {58 vars in 1023 bytes} [Thu May 19 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:14.820685 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecce378-4965-4084-83c1-590eb487c2d8 None None] Authenticating user token {{(pid=270181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:14.835452 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecce378-4965-4084-83c1-590eb487c2d8 None None] Validating token access rules against request {{(pid=270181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:14.841043 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bfd9a-1386-4803-bcc0-3a63ad57b0b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8088e85aab0b4adcb6c53d99a531515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ee8ea604a74960b24ae9ea026ee3e5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:14.841686 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bfd9a-1386-4803-bcc0-3a63ad57b0b0 service nova] REQUEST_METHOD: `GET` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:14.841971 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bfd9a-1386-4803-bcc0-3a63ad57b0b0 service nova] SCRIPT_NAME: `/identity` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:14.842252 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bfd9a-1386-4803-bcc0-3a63ad57b0b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:14.851209 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bfd9a-1386-4803-bcc0-3a63ad57b0b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:14.852822 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bfd9a-1386-4803-bcc0-3a63ad57b0b0 service nova] RBAC: Authorization granted {{(pid=270181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:14.862672 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: [pid: 270181|app: 0|req: 693/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Thu May 19 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:24.762372 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: DEBUG dbcounter [-] [270180] Writing DB stats keystone:SELECT=21 {{(pid=270180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:24.858362 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: DEBUG dbcounter [-] [270181] Writing DB stats keystone:SELECT=54 {{(pid=270181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:43.937328 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: Thu May 19 14:57:43 2022 - graceful shutdown triggered... May 19 14:57:43.937102 dv-cinder-788367-10-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 19 14:57:43.938100 dv-cinder-788367-10-iscsi devstack@keystone.service[270180]: Gracefully killing worker 1 (pid: 270180)... May 19 14:57:43.938543 dv-cinder-788367-10-iscsi devstack@keystone.service[270181]: Gracefully killing worker 2 (pid: 270181)... May 19 14:57:44.938111 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: worker 1 buried after 1 seconds May 19 14:57:44.938111 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: worker 2 buried after 1 seconds May 19 14:57:44.938111 dv-cinder-788367-10-iscsi devstack@keystone.service[270169]: goodbye to uWSGI. May 19 14:57:44.939667 dv-cinder-788367-10-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 19 14:57:44.940208 dv-cinder-788367-10-iscsi systemd[1]: Stopped Devstack devstack@keystone.service.